-- Logs begin at Wed 2022-08-31 00:32:43 UTC, end at Wed 2022-08-31 01:45:22 UTC. -- Aug 31 01:13:36.411459 dv-cinder-855288-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 01:13:36.421165 dv-cinder-855288-2-iscsi devstack@n-api.service[105992]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 01:13:36.423254 dv-cinder-855288-2-iscsi devstack@n-api.service[105992]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 01:13:36 2022] *** Aug 31 01:13:36.423254 dv-cinder-855288-2-iscsi devstack@n-api.service[105992]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 01:13:36.423254 dv-cinder-855288-2-iscsi devstack@n-api.service[105992]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 01:13:36.423254 dv-cinder-855288-2-iscsi devstack@n-api.service[105992]: nodename: dv-cinder-855288-2-iscsi Aug 31 01:13:36.423254 dv-cinder-855288-2-iscsi devstack@n-api.service[105992]: machine: x86_64 Aug 31 01:13:36.423254 dv-cinder-855288-2-iscsi devstack@n-api.service[105992]: clock source: unix Aug 31 01:13:36.423254 dv-cinder-855288-2-iscsi devstack@n-api.service[105992]: pcre jit disabled Aug 31 01:13:36.423254 dv-cinder-855288-2-iscsi devstack@n-api.service[105992]: detected number of CPU cores: 4 Aug 31 01:13:36.423254 dv-cinder-855288-2-iscsi devstack@n-api.service[105992]: current working directory: / Aug 31 01:13:36.423254 dv-cinder-855288-2-iscsi devstack@n-api.service[105992]: detected binary path: /usr/bin/uwsgi-core Aug 31 01:13:36.423827 dv-cinder-855288-2-iscsi devstack@n-api.service[105992]: your processes number limit is 47680 Aug 31 01:13:36.423827 dv-cinder-855288-2-iscsi devstack@n-api.service[105992]: your memory page size is 4096 bytes Aug 31 01:13:36.423827 dv-cinder-855288-2-iscsi devstack@n-api.service[105992]: detected max file descriptor number: 2048 Aug 31 01:13:36.423827 dv-cinder-855288-2-iscsi devstack@n-api.service[105992]: lock engine: pthread robust mutexes Aug 31 01:13:36.423827 dv-cinder-855288-2-iscsi devstack@n-api.service[105992]: thunder lock: enabled Aug 31 01:13:36.423827 dv-cinder-855288-2-iscsi devstack@n-api.service[105992]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 01:13:36.423827 dv-cinder-855288-2-iscsi devstack@n-api.service[105992]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 01:13:36.463165 dv-cinder-855288-2-iscsi devstack@n-api.service[105992]: Python main interpreter initialized at 0x55a1c76789c0 Aug 31 01:13:36.463165 dv-cinder-855288-2-iscsi devstack@n-api.service[105992]: python threads support enabled Aug 31 01:13:36.463165 dv-cinder-855288-2-iscsi devstack@n-api.service[105992]: your server socket listen backlog is limited to 100 connections Aug 31 01:13:36.463165 dv-cinder-855288-2-iscsi devstack@n-api.service[105992]: your mercy for graceful operations on workers is 90 seconds Aug 31 01:13:36.463513 dv-cinder-855288-2-iscsi devstack@n-api.service[105992]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 01:13:36.463588 dv-cinder-855288-2-iscsi devstack@n-api.service[105992]: *** Operational MODE: preforking *** Aug 31 01:13:36.463819 dv-cinder-855288-2-iscsi devstack@n-api.service[105992]: *** uWSGI is running in multiple interpreter mode *** Aug 31 01:13:36.463819 dv-cinder-855288-2-iscsi devstack@n-api.service[105992]: spawned uWSGI master process (pid: 105992) Aug 31 01:13:36.464012 dv-cinder-855288-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 31 01:13:36.465102 dv-cinder-855288-2-iscsi devstack@n-api.service[105992]: spawned uWSGI worker 1 (pid: 105993, cores: 1) Aug 31 01:13:36.465102 dv-cinder-855288-2-iscsi devstack@n-api.service[105992]: spawned uWSGI worker 2 (pid: 105994, cores: 1) Aug 31 01:13:36.465102 dv-cinder-855288-2-iscsi devstack@n-api.service[105992]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 01:13:37.121263 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 01:13:37.121864 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 01:13:38.205362 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 01:13:38.205362 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: from cryptography.utils import int_from_bytes Aug 31 01:13:38.205983 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 01:13:38.205983 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: from cryptography.utils import int_from_bytes Aug 31 01:13:38.206204 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 01:13:38.206204 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: from cryptography.utils import int_from_bytes Aug 31 01:13:38.206619 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 01:13:38.206619 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: from cryptography.utils import int_from_bytes Aug 31 01:13:40.659464 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 01:13:40.660025 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 01:13:40.660231 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 01:13:40.660590 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 01:13:40.660877 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 01:13:40.661258 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.661582 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.661693 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 01:13:40.662063 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.662158 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 01:13:40.662238 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.662449 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 01:13:40.662675 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.662810 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 01:13:40.662986 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.663079 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 01:13:40.663304 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.663475 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.663620 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.663773 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.663944 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.664097 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.664188 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.664418 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.664511 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.664768 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.664858 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855288-2-iscsi {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.665081 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.665179 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.665401 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.665508 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.665715 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.665808 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.666033 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.666149 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.666289 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.666371 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.666601 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.666683 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.666926 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855288-2-iscsi {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.667018 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.667248 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.667412 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.667553 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.668544 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.668650 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.668744 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.668814 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.668889 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.668954 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.669025 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.669091 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.669155 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.669223 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.669391 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.669590 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.669698 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.669909 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.670012 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.670215 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.670299 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.670527 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.670624 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.670865 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.670986 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855288-2-iscsi {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.671179 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.671301 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.671488 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.671611 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.671810 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.671906 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.672120 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.672313 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.672445 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.672623 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.672774 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.672959 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.673179 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855288-2-iscsi {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.673275 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.673496 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.673608 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.673806 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.673889 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.674118 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.674202 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.674494 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.674591 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.674813 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.674897 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.675128 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.675210 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.675425 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.675511 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.675732 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.675816 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.676041 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.676172 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.676358 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.676462 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.676659 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.676785 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.676988 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.677102 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.677234 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.677330 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.677541 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.677627 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.678371 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.678477 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.678702 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.678796 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.679021 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.679111 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.679270 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.679385 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.679521 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.679615 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.679843 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.679937 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.680151 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.680245 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.680457 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.680549 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.680785 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.680893 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.681094 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.681180 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.681354 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.681440 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.681606 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.681702 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.681927 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.682020 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.682247 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.682342 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.682556 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.682643 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.682864 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.682956 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.683171 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.683256 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.683476 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.683611 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.683784 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.683870 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.684090 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.684181 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.684396 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.684482 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.684702 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.684817 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.685038 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.685146 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.685351 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.685438 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.685674 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.685765 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.685980 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.686075 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.686298 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.686387 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.686619 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.686706 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.686918 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.687017 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.687225 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.687334 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.687527 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.687613 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.687844 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.687937 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.688158 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.688248 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.688462 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.688545 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.688712 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.688836 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.689032 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.689116 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.689341 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.689449 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.689657 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.689753 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.689966 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.690104 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.690270 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.690403 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.690575 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.690713 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.690861 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.691002 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.691143 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.691289 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.691431 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.691566 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.691708 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.691849 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.692018 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.692162 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.692323 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.692459 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.692624 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.692790 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.692946 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.693033 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.693244 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.693338 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.693596 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.694229 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.694436 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.694527 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.694778 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.694861 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.695093 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.695169 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.695402 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.695488 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.695711 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.695793 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.696013 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.696101 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.696320 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.696428 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.696620 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.696705 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.696956 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.697043 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.697266 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.697364 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.697570 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.697662 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.697873 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.697958 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.698179 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.698274 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.698481 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.698566 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.698786 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.698871 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.699091 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.699188 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.699387 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.699523 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.699693 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.699780 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.700001 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.700094 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.700305 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.700390 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.700606 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.700691 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.700931 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.701040 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.701232 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.701326 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.701533 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.701619 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.701835 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.701922 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.702134 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.702220 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.702435 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.702522 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.702732 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.702821 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.703034 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.703127 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.703337 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.703425 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.703641 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.703726 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.703944 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.704289 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.704505 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.704590 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.704826 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.704934 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.705128 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.705218 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.705460 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.705562 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.705765 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.705852 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.706074 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.706202 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.706384 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.706512 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.706687 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.706784 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.707005 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:13:40.707140 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.707338 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.707448 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.707654 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.707749 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.707979 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.708073 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.708290 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.708388 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.708601 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.708703 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.708935 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.709034 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.709279 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.709373 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.709592 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.709690 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.709921 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.710014 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.710232 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.710317 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.710546 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.710633 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.710858 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.710954 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.711163 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.711258 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.711480 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.711567 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.711799 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.711893 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.712113 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.712200 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.712425 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.712511 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.712754 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.712855 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.713080 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.713168 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.713390 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.713485 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.713711 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.713798 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.714034 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.714128 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.714342 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.714429 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.714651 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.714746 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.714959 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.715048 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.715278 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.715373 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.715605 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.715705 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.715917 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.716004 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.716230 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.716316 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.716541 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.716652 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.716873 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.716974 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.717186 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.717276 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.717496 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.717594 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.717807 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.717895 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.718121 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.718208 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.718428 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.718523 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.718738 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.718831 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.719060 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.719149 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.719376 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.719473 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.719684 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.719777 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.720001 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.720088 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.720312 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.720398 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.720620 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.720712 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.720958 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.721057 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.721267 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.721430 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.721568 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.721795 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.721897 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.722142 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.722232 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.722447 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.722535 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.722750 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.722866 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.723070 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.723214 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.723396 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.723574 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.723704 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.723901 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.724036 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.724211 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.724343 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.724521 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.724652 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.724872 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.725011 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.725190 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.725322 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.725500 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.725628 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.725827 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.725994 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.726162 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.726256 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.726472 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.726579 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.726810 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.726910 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.727116 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.727204 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.727422 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.727507 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.727734 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.727824 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.728040 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.728125 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.728345 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.728431 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.728657 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.728764 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.728993 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.729079 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.729300 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.729387 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.729610 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.729698 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.729926 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.730020 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.730231 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.730329 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.730551 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.730636 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.730857 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.730943 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.731164 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.731259 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.731478 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.731565 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.731791 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.731886 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.732108 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.732207 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.732422 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.732509 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.732775 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.732866 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.733063 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.733167 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.733372 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.733460 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.733677 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.733763 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.733980 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.734076 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.734283 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.734371 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.734593 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.734680 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.734899 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.734995 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.735205 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.735300 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.735512 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.735598 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.735814 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.735901 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.736116 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.736211 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.736438 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.736525 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.736765 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.736879 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.737070 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.737168 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.737372 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.737486 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.737678 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.737790 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.737987 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.738082 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.738297 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.738393 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.738607 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.738694 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.738915 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.739001 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.739242 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.739343 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.739553 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.739639 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.739866 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.739993 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.740171 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.740268 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.741031 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.741130 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.741346 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.741432 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.741659 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.741756 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.741970 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.742065 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.742292 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.742387 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.742604 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.742693 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.742923 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.743010 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.743232 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.743319 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.743557 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.743645 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.743869 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.743955 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.744187 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.744282 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.744489 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.744576 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.744828 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.744931 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.745152 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.745247 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.745469 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.745556 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.745791 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.745895 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.746103 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.746203 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.746414 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.746501 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.746728 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.746823 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.747038 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.747135 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.747345 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.747443 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.747655 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.747740 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.747967 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.748067 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.748287 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.748383 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.748627 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.748738 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.748978 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.749088 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.749294 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.749381 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.749612 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.749700 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.749919 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.750005 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.750239 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.750342 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.750547 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.750635 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.750858 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.750952 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.751179 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.751265 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.751492 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.751580 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.751803 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.751890 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.752111 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.752197 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.752431 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.752516 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.752768 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.752861 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.753070 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.753156 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.753377 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.753475 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.753680 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.753774 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.753982 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.754069 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.754291 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.754387 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.754606 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.754693 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.754916 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.755010 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.755222 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.755386 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.755527 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.755614 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.755838 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.755936 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.756700 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.756839 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.757033 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.757129 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.757343 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.757437 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.757653 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.757745 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.757972 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.758066 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.758284 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.758376 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.758597 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.758695 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.758905 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.758999 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.759211 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.759303 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.759515 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.759608 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.759821 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.759912 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.760166 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.760266 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.760431 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.760525 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.760744 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.760850 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.761061 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.761163 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.761395 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.761488 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.761704 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.761795 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.762010 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.762111 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.762315 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.762407 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.762633 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.762725 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.762942 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.763048 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.763250 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.763343 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.763556 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.763656 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.763862 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.763966 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.764180 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.764274 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.764493 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.764587 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.764818 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.764923 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.765130 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.765214 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.765442 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.765525 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.765753 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.765850 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.766061 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.766144 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.766371 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.766455 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.766678 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.766779 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.766992 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.767086 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.767301 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.767394 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.767604 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.767690 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.767914 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.767997 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.768230 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.768324 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.768544 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.768813 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.768911 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.769149 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.769241 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.769463 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.769550 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.769780 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.769864 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.770091 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.770176 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.770404 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.770497 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.770716 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.770810 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.771034 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.771120 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.771365 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.771613 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.771699 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.771964 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.772048 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.772288 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.772372 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.772591 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.772676 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.772927 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.773029 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.773235 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.773326 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.773537 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.773635 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.773840 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.773931 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.774148 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.774232 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.774450 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.774543 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.774754 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.774846 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.775056 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.775141 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.775359 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.775455 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.775672 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.775757 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.775976 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.776060 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.776287 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.776373 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.776591 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.776675 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.776929 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.777022 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.777237 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.777324 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.777538 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.777622 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.777841 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.777936 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.778144 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.778229 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.778458 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.778542 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.778763 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.778866 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.779078 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.779171 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.779383 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.779475 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.779707 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.779870 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.780016 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.780101 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.780323 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.780463 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.780628 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.780763 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.780961 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.781048 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.781261 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.781351 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.781564 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.781662 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.781872 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.781957 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.782178 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.782263 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.782480 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.782566 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.782790 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.782882 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.783100 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.783192 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.783409 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.783502 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.783717 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.783808 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.784019 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.784103 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.784326 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.784411 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.784628 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.784747 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.784963 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.785060 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.785269 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.785396 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.785565 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.785684 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.785865 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.785959 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.786175 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.786258 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.786481 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.786573 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.786782 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.786879 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.787090 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.787173 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.787415 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.787498 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.787729 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.787826 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.788030 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.788120 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.788334 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.788419 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.788633 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.788748 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.788965 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.789051 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.789273 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.789357 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.789577 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.789663 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.789887 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.789970 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.790195 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.790293 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.790504 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.790595 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.790809 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.790894 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.791114 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.791205 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.791414 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.791499 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.791719 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.791803 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.792027 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.792111 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.792332 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.792417 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.792655 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.792755 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.792987 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.793084 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.793294 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.793377 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.793596 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.793687 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.793900 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.793993 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.794205 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.794298 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.794511 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.794595 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.794811 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.794908 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.795116 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.795208 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.795419 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.795550 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.795722 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.795817 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.796026 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.796110 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.796331 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.796415 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.796635 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.796784 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.796962 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.797057 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.797267 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.797362 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.797568 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.797668 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.797874 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.797959 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.798178 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.798275 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.798483 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.798584 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.798786 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.798872 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.799108 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.799194 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.799417 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.799504 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.799723 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.799808 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.800028 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.800122 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.800338 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.800431 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.800637 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.800756 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.800979 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.801077 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.801291 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.801377 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.801606 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.801697 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.801909 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.802002 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.802210 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.802295 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.802531 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.802616 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.802842 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.803438 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.803676 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.803768 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.803981 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.804065 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.804298 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.804392 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.804614 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.804698 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.804949 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.805034 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.805253 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.805339 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.805561 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.805653 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.805858 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.805941 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.806167 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.806261 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.806475 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.806560 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.806784 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.806869 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.807094 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.807180 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.807407 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.807507 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.807707 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.807794 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.808013 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.808098 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.808316 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.808402 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.808623 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.808851 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.808943 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.809021 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.809244 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.809330 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.809558 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.809650 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.809864 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.809947 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.810166 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.810251 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.810474 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.810566 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.810783 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.810867 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.811087 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.811177 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.811387 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.811478 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.811696 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.811814 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.812003 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.812129 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.812329 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.812442 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.812640 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.812767 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.812968 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.813082 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.813279 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.813392 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.813586 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.813707 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.813899 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.814020 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.814203 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.814324 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.814629 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.814739 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.814943 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.815051 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.815254 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.815362 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.815560 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.815673 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.815872 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.815965 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.816183 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.816268 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.816500 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.816592 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.816840 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.816952 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.817146 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.817238 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.817481 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.817573 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.817786 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.817892 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.818108 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.818193 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.818413 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.818499 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.819296 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.819394 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.819615 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.819706 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.819929 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.820014 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.820257 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.820343 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.820565 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.820704 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.820901 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.821037 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.821210 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.821351 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.821536 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.821676 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.821844 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.822000 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.822167 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.822326 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.822590 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.822675 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.822907 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.822992 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.823215 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.823310 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.823541 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.823626 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.823866 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.823951 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.824178 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.824270 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.824493 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.824580 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.824826 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.824916 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.825154 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.825252 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.825479 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.825565 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.825793 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.825876 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.826107 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.826202 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.826433 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.826525 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.826761 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.826846 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.827076 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.827170 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.827394 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.827525 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.827701 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.827786 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.828029 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.828133 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.828329 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.828420 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.828639 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.828778 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.828970 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.829319 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.829539 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.829636 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.829864 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.829950 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.830169 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.830255 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.830481 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.830567 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.830800 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.830885 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.831110 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.831196 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.831414 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.831500 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.831720 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.831805 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.832043 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.832129 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.832350 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.832435 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.832673 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.832781 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.833012 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.833095 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.833325 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.833408 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.833643 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.833738 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.833945 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.834037 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.834273 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.834361 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.834580 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.834674 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.834883 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.834967 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.835188 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.835273 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.835492 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.835587 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.835811 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.835943 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.836127 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.836210 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.836446 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.836537 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.836776 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.836867 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.837104 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.837189 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.837411 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.837497 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.837717 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.837809 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.838021 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.838122 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.838326 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.838412 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.838665 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.838750 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.838971 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.839058 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.839338 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.839414 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.839643 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.839729 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.839953 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.840047 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.840258 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.840351 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.840564 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.840657 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.840900 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.840999 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.841214 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.841300 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.841520 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.841605 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.841827 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.841921 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.842133 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.842218 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.842456 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.842542 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.842761 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.842859 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.843085 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.843170 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.843388 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.843472 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.843691 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.843787 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.843995 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.844081 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.844301 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.844388 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.844610 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.844697 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.844942 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.845029 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.845269 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.845365 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.845576 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.845669 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.845894 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.845986 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.846205 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.846307 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.846513 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.846600 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.846819 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.846911 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.847124 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.847218 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.847439 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.847522 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.847756 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.847857 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.848072 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.848166 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.848380 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.848472 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.848694 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.848842 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.849032 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.849169 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.849349 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.849443 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.849665 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.849886 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.850010 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.850216 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.850311 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.850531 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.850618 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.850849 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.850952 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.851161 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.851248 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.851477 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.851563 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.851790 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.851883 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.852101 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.852187 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.852411 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.852643 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.852750 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.853002 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.853089 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.853322 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.853416 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.853639 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.853732 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.853953 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.854039 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.854272 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.854357 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.854587 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.854681 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.854899 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.854984 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.855210 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.855305 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.855520 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.855618 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.855830 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.855914 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.856164 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.856249 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.856471 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.856558 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.856808 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.856896 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.857126 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.857211 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.857440 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.857534 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.857753 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.857838 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.858064 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.858209 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.858378 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.858463 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.858690 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.858774 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.859000 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.859094 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.859309 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.859395 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.859621 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.859707 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.859933 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.860027 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.860247 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.860394 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.860564 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.860650 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.860909 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.861000 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.861220 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.861304 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.861532 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.861616 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.861844 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.861929 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.862156 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.862357 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.862471 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.862673 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.862772 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.863007 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.863092 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.863331 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.863416 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.863656 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.863749 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.863971 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.864056 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.864288 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.864380 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.864616 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.864702 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.864962 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.865160 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.865269 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.865987 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.866096 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.866325 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.866419 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.866653 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.866739 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.866981 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.867076 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.867290 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.867375 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.867597 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.867682 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.867916 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.868002 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.868222 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.868306 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.868529 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.868768 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.868874 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.869115 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.869208 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.869432 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.869519 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.869759 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.869853 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.870080 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.870170 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.870388 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.870473 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.870692 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.870785 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.871009 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.871107 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.871318 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.871547 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.871641 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.871898 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.872031 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.872216 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.872308 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.872517 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.872615 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.872852 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.872947 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.873165 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.873267 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.873473 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.873571 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.873778 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.873866 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.874088 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.874189 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.874393 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.874481 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.874712 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.874806 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.875012 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.875106 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.875314 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.875404 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.875615 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.875703 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.875928 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.876021 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.876228 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.876330 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.876533 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.876633 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.876856 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.876951 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.877162 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.877261 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.877473 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.877603 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.877776 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.877878 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.878082 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.878177 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.878382 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.878471 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.878695 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.878862 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.878999 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.879087 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.879306 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.879408 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.879611 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.879709 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.879920 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.880015 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.880233 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.880321 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.880537 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.880632 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.880869 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.880960 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.881234 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.881339 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.881551 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.881648 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.881858 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.881945 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.882170 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.882265 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.882515 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.882609 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.882833 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.882920 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.883140 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.883364 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.883469 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.883701 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.883797 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.884022 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.884111 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.884354 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.884455 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.884667 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.884784 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.885010 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.885106 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.885327 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.885442 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.885627 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.885719 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.885953 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.886184 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.886280 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.886536 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.886623 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.886853 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.886951 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.887164 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.887261 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.887476 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.887564 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.887786 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.887878 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.888097 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.888198 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.888402 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.888490 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.888710 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.888832 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.889042 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.889133 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.889357 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.889474 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.889667 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.889765 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.889977 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.890073 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.890286 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.890389 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.890597 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.890697 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.890913 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.891048 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.891235 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.891325 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.891545 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.891646 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.891861 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.891951 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.892538 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.892705 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.892705 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.893030 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.893030 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.893312 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.893454 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.893608 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.893608 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.893887 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.894033 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.894176 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.894320 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.894465 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.894621 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.894765 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.894909 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.895051 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.895051 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.895342 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.895495 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.895640 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.895782 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.895925 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.896067 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.896210 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.896362 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.896506 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.897197 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.897420 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.897570 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.897738 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.897884 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.898028 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.898254 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.898404 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.898404 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.898777 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.898931 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.899075 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.899225 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.899369 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.899521 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.900256 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.900407 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.900552 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.900696 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.900815 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.900899 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.900980 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.901058 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.901136 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.901213 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.901298 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.901377 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.901453 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.901540 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.901629 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.901707 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.901792 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.901960 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.902110 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.902271 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.902442 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.902576 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.902752 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.902879 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.903059 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.903184 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.903366 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.903489 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.903678 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.903797 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.904002 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.904094 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.904315 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.904409 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.904621 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.904707 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.904960 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.905058 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.905273 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.905367 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.905579 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.905726 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.905884 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.905970 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.906185 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.906282 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.906490 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.906575 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.906793 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.906879 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.907096 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.907182 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.907411 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.907545 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.907703 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.907789 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.907992 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.908077 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.908301 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.908425 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.908609 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.908705 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.908945 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.909053 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.909253 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.909359 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.909603 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.909703 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.909863 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.909961 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.910164 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.910268 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.910467 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.910573 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.910793 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.910896 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.911133 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.911232 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.911445 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.911551 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.911761 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.911857 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.912075 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.912179 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.912444 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.912555 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.912771 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.912868 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.913080 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.913168 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.913410 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.913511 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.913725 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.913811 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.914029 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.914117 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.914355 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.914444 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.914667 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.914761 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.914982 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.915069 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.915298 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.915386 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.915607 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.915695 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.915919 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.916007 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.916231 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.916321 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.916541 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.916628 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.916876 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.916980 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.917190 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.917286 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.917518 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.917666 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.917817 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.917959 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.918129 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.918226 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.918441 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.918531 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.918755 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.918850 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.919066 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.919153 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.919388 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.919475 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.919706 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.919795 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.920012 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.920098 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.920326 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.920412 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.920642 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.920769 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.920986 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.921082 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.921307 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.921395 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.921622 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.921712 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.921942 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.922029 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.922259 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.922405 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.922571 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.922661 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.922874 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.922962 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.923117 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 01:13:40.923219 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.923515 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.923846 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.924196 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.924513 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.924931 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.925208 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.925525 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.925839 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.926146 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:13:40.926390 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 01:13:41.077183 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO dbcounter [None req-beab42aa-9fbf-49d1-b246-17c53020828a None None] Registered counter for database nova_api Aug 31 01:13:41.080205 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: INFO dbcounter [None req-4cc70423-7f9f-40c7-8ee2-53516d5575a3 None None] Registered counter for database nova_api Aug 31 01:13:41.098161 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG oslo_db.sqlalchemy.engines [None req-beab42aa-9fbf-49d1-b246-17c53020828a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105993) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 01:13:41.100256 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG oslo_db.sqlalchemy.engines [None req-4cc70423-7f9f-40c7-8ee2-53516d5575a3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105994) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 01:13:41.105310 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG dbcounter [-] [105993] Writer thread running {{(pid=105993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 01:13:41.106822 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG dbcounter [-] [105994] Writer thread running {{(pid=105994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 01:13:41.162511 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.context [None req-beab42aa-9fbf-49d1-b246-17c53020828a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9(cell1) {{(pid=105993) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 01:13:41.163891 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.context [None req-4cc70423-7f9f-40c7-8ee2-53516d5575a3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9(cell1) {{(pid=105994) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 01:13:41.166272 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG oslo_concurrency.lockutils [None req-beab42aa-9fbf-49d1-b246-17c53020828a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:13:41.166744 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG oslo_concurrency.lockutils [None req-beab42aa-9fbf-49d1-b246-17c53020828a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:13:41.167690 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG oslo_concurrency.lockutils [None req-4cc70423-7f9f-40c7-8ee2-53516d5575a3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:13:41.168167 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG oslo_concurrency.lockutils [None req-4cc70423-7f9f-40c7-8ee2-53516d5575a3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:13:41.168303 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG oslo_concurrency.lockutils [None req-beab42aa-9fbf-49d1-b246-17c53020828a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:13:41.169044 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG oslo_concurrency.lockutils [None req-beab42aa-9fbf-49d1-b246-17c53020828a None None] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:13:41.169499 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG oslo_concurrency.lockutils [None req-beab42aa-9fbf-49d1-b246-17c53020828a None None] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:13:41.169778 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG oslo_concurrency.lockutils [None req-4cc70423-7f9f-40c7-8ee2-53516d5575a3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:13:41.170521 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG oslo_concurrency.lockutils [None req-4cc70423-7f9f-40c7-8ee2-53516d5575a3 None None] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:13:41.170965 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG oslo_concurrency.lockutils [None req-4cc70423-7f9f-40c7-8ee2-53516d5575a3 None None] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:13:41.171482 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG oslo_concurrency.lockutils [None req-beab42aa-9fbf-49d1-b246-17c53020828a None None] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:13:41.172986 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG oslo_concurrency.lockutils [None req-4cc70423-7f9f-40c7-8ee2-53516d5575a3 None None] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:13:41.173447 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO dbcounter [None req-beab42aa-9fbf-49d1-b246-17c53020828a None None] Registered counter for database nova_cell0 Aug 31 01:13:41.174942 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: INFO dbcounter [None req-4cc70423-7f9f-40c7-8ee2-53516d5575a3 None None] Registered counter for database nova_cell0 Aug 31 01:13:41.177442 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO dbcounter [None req-beab42aa-9fbf-49d1-b246-17c53020828a None None] Registered counter for database nova_cell1 Aug 31 01:13:41.178968 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: INFO dbcounter [None req-4cc70423-7f9f-40c7-8ee2-53516d5575a3 None None] Registered counter for database nova_cell1 Aug 31 01:13:41.184464 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG oslo_db.sqlalchemy.engines [None req-beab42aa-9fbf-49d1-b246-17c53020828a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105993) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 01:13:41.186795 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG oslo_db.sqlalchemy.engines [None req-4cc70423-7f9f-40c7-8ee2-53516d5575a3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105994) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 01:13:41.189006 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG oslo_db.sqlalchemy.engines [None req-4cc70423-7f9f-40c7-8ee2-53516d5575a3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105994) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 01:13:41.189245 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG dbcounter [-] [105993] Writer thread running {{(pid=105993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 01:13:41.189885 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG oslo_db.sqlalchemy.engines [None req-beab42aa-9fbf-49d1-b246-17c53020828a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105993) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 01:13:41.195318 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG dbcounter [-] [105994] Writer thread running {{(pid=105994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 01:13:41.196806 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG dbcounter [-] [105994] Writer thread running {{(pid=105994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 01:13:41.328988 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG dbcounter [-] [105993] Writer thread running {{(pid=105993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 01:13:41.337840 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO dbcounter [None req-beab42aa-9fbf-49d1-b246-17c53020828a None None] Registered counter for database nova_cell0 Aug 31 01:13:41.339923 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: INFO dbcounter [None req-4cc70423-7f9f-40c7-8ee2-53516d5575a3 None None] Registered counter for database nova_cell0 Aug 31 01:13:41.345492 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG oslo_db.sqlalchemy.engines [None req-beab42aa-9fbf-49d1-b246-17c53020828a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105993) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 01:13:41.349028 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG oslo_db.sqlalchemy.engines [None req-4cc70423-7f9f-40c7-8ee2-53516d5575a3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105994) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 01:13:41.350190 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG dbcounter [-] [105993] Writer thread running {{(pid=105993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 01:13:41.353723 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG dbcounter [-] [105994] Writer thread running {{(pid=105994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 01:13:41.774226 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: WARNING keystonemiddleware.auth_token [None req-beab42aa-9fbf-49d1-b246-17c53020828a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 01:13:41.781539 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: WARNING keystonemiddleware.auth_token [None req-beab42aa-9fbf-49d1-b246-17c53020828a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 01:13:41.794983 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: WARNING keystonemiddleware.auth_token [None req-4cc70423-7f9f-40c7-8ee2-53516d5575a3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 01:13:41.802235 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: WARNING keystonemiddleware.auth_token [None req-4cc70423-7f9f-40c7-8ee2-53516d5575a3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 01:13:42.122567 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: WARNING keystonemiddleware.auth_token [None req-beab42aa-9fbf-49d1-b246-17c53020828a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 01:13:42.128445 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: WARNING keystonemiddleware.auth_token [None req-beab42aa-9fbf-49d1-b246-17c53020828a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 01:13:42.134285 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a1c76789c0 pid: 105993 (default app) Aug 31 01:13:42.136346 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi [None req-beab42aa-9fbf-49d1-b246-17c53020828a None None] Calling method '>' {{(pid=105993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:13:42.137569 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO nova.api.openstack.requestlog [None req-beab42aa-9fbf-49d1-b246-17c53020828a None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001762 Aug 31 01:13:42.137987 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: [pid: 105993|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Wed Aug 31 01:13:42 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:13:42.144469 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: WARNING keystonemiddleware.auth_token [None req-4cc70423-7f9f-40c7-8ee2-53516d5575a3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 01:13:42.150483 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: WARNING keystonemiddleware.auth_token [None req-4cc70423-7f9f-40c7-8ee2-53516d5575a3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 01:13:42.155740 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a1c76789c0 pid: 105994 (default app) Aug 31 01:15:02.534547 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi [None req-beab42aa-9fbf-49d1-b246-17c53020828a None None] Calling method '>' {{(pid=105993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:15:02.535525 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO nova.api.openstack.requestlog [None req-beab42aa-9fbf-49d1-b246-17c53020828a None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 31 01:15:02.535920 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: [pid: 105993|app: 0|req: 2/2] 10.222.0.20 () {54 vars in 931 bytes} [Wed Aug 31 01:15:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:15:02.548101 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG dbcounter [-] [105994] Writing DB stats nova_api:SELECT=3 {{(pid=105994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:15:02.549746 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG dbcounter [-] [105994] Writing DB stats nova_cell0:SELECT=3 {{(pid=105994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:15:02.551253 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG dbcounter [-] [105994] Writing DB stats nova_cell1:SELECT=3 {{(pid=105994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:15:02.552527 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG dbcounter [-] [105994] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:15:03.433699 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi [None req-2b731722-cf24-4970-a28a-10cccb0c45f2 admin admin] Calling method '>' {{(pid=105994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:15:03.469520 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: INFO nova.api.openstack.requestlog [None req-2b731722-cf24-4970-a28a-10cccb0c45f2 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.926445 Aug 31 01:15:03.470337 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: [pid: 105994|app: 0|req: 1/3] 10.222.0.20 () {60 vars in 1292 bytes} [Wed Aug 31 01:15:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:15:05.825534 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi [None req-beab42aa-9fbf-49d1-b246-17c53020828a None None] Calling method '>' {{(pid=105993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:15:05.826481 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO nova.api.openstack.requestlog [None req-beab42aa-9fbf-49d1-b246-17c53020828a None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 31 01:15:05.835892 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: [pid: 105993|app: 0|req: 3/4] 10.222.0.20 () {54 vars in 931 bytes} [Wed Aug 31 01:15:05 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:15:06.284101 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi [None req-fa098532-9cfe-41a6-8c3e-52ae1d90eea7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "swap": 0, "id": "c1", "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=105994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:15:06.388653 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: INFO nova.api.openstack.requestlog [None req-fa098532-9cfe-41a6-8c3e-52ae1d90eea7 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.555441 Aug 31 01:15:06.389254 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: [pid: 105994|app: 0|req: 2/5] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Aug 31 01:15:05 2022] POST /compute/v2.1/flavors => generated 407 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 01:15:06.404311 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG dbcounter [-] [105993] Writing DB stats nova_api:SELECT=3 {{(pid=105993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:15:06.417899 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG dbcounter [-] [105993] Writing DB stats nova_cell0:SELECT=3 {{(pid=105993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:15:06.417899 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG dbcounter [-] [105993] Writing DB stats nova_cell1:SELECT=3 {{(pid=105993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:15:06.417899 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG dbcounter [-] [105993] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:15:06.620001 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi [None req-32f6722f-ff32-44f8-8298-35974ef78f7a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:15:06.758517 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO nova.api.openstack.requestlog [None req-32f6722f-ff32-44f8-8298-35974ef78f7a admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.359752 Aug 31 01:15:06.759103 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: [pid: 105993|app: 0|req: 4/6] 10.222.0.20 () {64 vars in 1336 bytes} [Wed Aug 31 01:15:06 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:15:09.123787 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi [None req-fa098532-9cfe-41a6-8c3e-52ae1d90eea7 admin admin] Calling method '>' {{(pid=105994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:15:09.124836 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: INFO nova.api.openstack.requestlog [None req-fa098532-9cfe-41a6-8c3e-52ae1d90eea7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 31 01:15:09.125236 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: [pid: 105994|app: 0|req: 3/7] 10.222.0.20 () {54 vars in 931 bytes} [Wed Aug 31 01:15:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:15:09.778638 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi [None req-cfd9e79c-df3e-44bc-b2e3-fe8ce7561e66 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "rxtx_factor": 1.0, "id": "d1", "os-flavor-access:is_public": true, "ram": 512, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1}} {{(pid=105993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:15:09.883665 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO nova.api.openstack.requestlog [None req-cfd9e79c-df3e-44bc-b2e3-fe8ce7561e66 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.752265 Aug 31 01:15:09.884531 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: [pid: 105993|app: 0|req: 5/8] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Aug 31 01:15:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 01:15:09.902649 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi [None req-8537a8fe-5332-46ec-8872-1de8fd7297ba admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:15:10.023913 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: INFO nova.api.openstack.requestlog [None req-8537a8fe-5332-46ec-8872-1de8fd7297ba admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.126694 Aug 31 01:15:10.032885 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: [pid: 105994|app: 0|req: 4/9] 10.222.0.20 () {64 vars in 1336 bytes} [Wed Aug 31 01:15:09 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:15:12.361025 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi [None req-cfd9e79c-df3e-44bc-b2e3-fe8ce7561e66 admin admin] Calling method '>' {{(pid=105993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:15:12.362041 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO nova.api.openstack.requestlog [None req-cfd9e79c-df3e-44bc-b2e3-fe8ce7561e66 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Aug 31 01:15:12.362493 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: [pid: 105993|app: 0|req: 6/10] 10.222.0.20 () {54 vars in 931 bytes} [Wed Aug 31 01:15:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:15:12.753963 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi [None req-279e593b-7adb-43d4-8210-c12f23eed9a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "os-flavor-access:is_public": true, "id": "d2", "name": "ds1G", "swap": 0}} {{(pid=105994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:15:12.837757 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: INFO nova.api.openstack.requestlog [None req-279e593b-7adb-43d4-8210-c12f23eed9a4 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.469022 Aug 31 01:15:12.838387 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: [pid: 105994|app: 0|req: 5/11] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Aug 31 01:15:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 01:15:12.850473 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi [None req-2ff8d1be-ef4f-4380-bea6-4c8491deb581 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:15:12.945669 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO nova.api.openstack.requestlog [None req-2ff8d1be-ef4f-4380-bea6-4c8491deb581 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098955 Aug 31 01:15:12.946251 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: [pid: 105993|app: 0|req: 7/12] 10.222.0.20 () {64 vars in 1336 bytes} [Wed Aug 31 01:15:12 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:15:15.305108 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi [None req-279e593b-7adb-43d4-8210-c12f23eed9a4 admin admin] Calling method '>' {{(pid=105994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:15:15.306299 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: INFO nova.api.openstack.requestlog [None req-279e593b-7adb-43d4-8210-c12f23eed9a4 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001655 Aug 31 01:15:15.306809 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: [pid: 105994|app: 0|req: 6/13] 10.222.0.20 () {54 vars in 931 bytes} [Wed Aug 31 01:15:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:15:15.738071 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi [None req-8090100b-ff77-4811-9c6d-98561f9f8966 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "ds2G", "ram": 2048, "swap": 0, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:15:15.813944 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO nova.api.openstack.requestlog [None req-8090100b-ff77-4811-9c6d-98561f9f8966 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.500916 Aug 31 01:15:15.814801 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: [pid: 105993|app: 0|req: 8/14] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Aug 31 01:15:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 01:15:15.826955 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi [None req-3a834e9f-ac43-4871-91cc-69225b605f91 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:15:15.916955 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: INFO nova.api.openstack.requestlog [None req-3a834e9f-ac43-4871-91cc-69225b605f91 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093661 Aug 31 01:15:15.917531 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: [pid: 105994|app: 0|req: 7/15] 10.222.0.20 () {64 vars in 1336 bytes} [Wed Aug 31 01:15:15 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:15:18.305450 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi [None req-8090100b-ff77-4811-9c6d-98561f9f8966 admin admin] Calling method '>' {{(pid=105993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:15:18.307272 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO nova.api.openstack.requestlog [None req-8090100b-ff77-4811-9c6d-98561f9f8966 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002281 Aug 31 01:15:18.311413 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: [pid: 105993|app: 0|req: 9/16] 10.222.0.20 () {54 vars in 931 bytes} [Wed Aug 31 01:15:18 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:15:18.745290 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi [None req-4127b663-8cc8-47ad-98bb-a9936a735b70 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds4G", "id": "d4", "swap": 0, "disk": 20, "vcpus": 4, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096}} {{(pid=105994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:15:18.923489 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: INFO nova.api.openstack.requestlog [None req-4127b663-8cc8-47ad-98bb-a9936a735b70 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.609438 Aug 31 01:15:18.924038 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: [pid: 105994|app: 0|req: 8/17] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Aug 31 01:15:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 01:15:18.936162 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi [None req-021d9f46-4e6a-4d18-9b2e-a303114f4627 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:15:19.100860 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO nova.api.openstack.requestlog [None req-021d9f46-4e6a-4d18-9b2e-a303114f4627 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.167518 Aug 31 01:15:19.100860 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: [pid: 105993|app: 0|req: 10/18] 10.222.0.20 () {64 vars in 1336 bytes} [Wed Aug 31 01:15:18 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:15:21.427521 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi [None req-4127b663-8cc8-47ad-98bb-a9936a735b70 admin admin] Calling method '>' {{(pid=105994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:15:21.428535 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: INFO nova.api.openstack.requestlog [None req-4127b663-8cc8-47ad-98bb-a9936a735b70 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 31 01:15:21.428980 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: [pid: 105994|app: 0|req: 9/19] 10.222.0.20 () {54 vars in 931 bytes} [Wed Aug 31 01:15:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:15:21.885927 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi [None req-a186ce19-ceb2-4a50-8527-69f69403b80e admin admin] Calling method '>' {{(pid=105993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:15:21.909968 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO nova.api.openstack.requestlog [None req-a186ce19-ceb2-4a50-8527-69f69403b80e admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.473451 Aug 31 01:15:21.910523 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: [pid: 105993|app: 0|req: 11/20] 10.222.0.20 () {60 vars in 1292 bytes} [Wed Aug 31 01:15:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 01:15:24.256051 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi [None req-4127b663-8cc8-47ad-98bb-a9936a735b70 admin admin] Calling method '>' {{(pid=105994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:15:24.257084 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: INFO nova.api.openstack.requestlog [None req-4127b663-8cc8-47ad-98bb-a9936a735b70 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 31 01:15:24.257485 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: [pid: 105994|app: 0|req: 10/21] 10.222.0.20 () {54 vars in 931 bytes} [Wed Aug 31 01:15:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:15:24.665449 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi [None req-931685aa-2aa8-40ed-b720-be289ec1cf6f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 512, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.tiny", "id": "1", "os-flavor-access:is_public": true}} {{(pid=105993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:15:24.747371 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO nova.api.openstack.requestlog [None req-931685aa-2aa8-40ed-b720-be289ec1cf6f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.483631 Aug 31 01:15:24.747849 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: [pid: 105993|app: 0|req: 12/22] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Aug 31 01:15:24 2022] POST /compute/v2.1/flavors => generated 402 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 01:15:24.759900 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi [None req-a660d685-6d83-41ea-83f0-60890b4d8ce7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:15:24.841598 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: INFO nova.api.openstack.requestlog [None req-a660d685-6d83-41ea-83f0-60890b4d8ce7 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085319 Aug 31 01:15:24.842165 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: [pid: 105994|app: 0|req: 11/23] 10.222.0.20 () {64 vars in 1333 bytes} [Wed Aug 31 01:15:24 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:15:27.155291 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi [None req-931685aa-2aa8-40ed-b720-be289ec1cf6f admin admin] Calling method '>' {{(pid=105993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:15:27.156222 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO nova.api.openstack.requestlog [None req-931685aa-2aa8-40ed-b720-be289ec1cf6f admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 31 01:15:27.156619 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: [pid: 105993|app: 0|req: 13/24] 10.222.0.20 () {54 vars in 931 bytes} [Wed Aug 31 01:15:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:15:27.524064 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi [None req-a31f75b5-e847-4579-80a3-998552f407e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "disk": 20, "ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.small"}} {{(pid=105994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:15:27.597198 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: INFO nova.api.openstack.requestlog [None req-a31f75b5-e847-4579-80a3-998552f407e2 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.434607 Aug 31 01:15:27.597758 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: [pid: 105994|app: 0|req: 12/25] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Aug 31 01:15:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 01:15:27.609903 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi [None req-547cb523-b8cd-478b-ad04-c74d2ad71d0c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:15:27.698334 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO nova.api.openstack.requestlog [None req-547cb523-b8cd-478b-ad04-c74d2ad71d0c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092053 Aug 31 01:15:27.698967 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: [pid: 105993|app: 0|req: 14/26] 10.222.0.20 () {64 vars in 1333 bytes} [Wed Aug 31 01:15:27 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:15:30.071147 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi [None req-a31f75b5-e847-4579-80a3-998552f407e2 admin admin] Calling method '>' {{(pid=105994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:15:30.072780 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: INFO nova.api.openstack.requestlog [None req-a31f75b5-e847-4579-80a3-998552f407e2 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002112 Aug 31 01:15:30.073178 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: [pid: 105994|app: 0|req: 13/27] 10.222.0.20 () {54 vars in 931 bytes} [Wed Aug 31 01:15:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:15:30.509045 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi [None req-3e39b4ad-be0c-42eb-81a4-8dca1b410d8f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 40, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "rxtx_factor": 1.0, "id": "3", "ram": 4096, "swap": 0}} {{(pid=105993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:15:30.570361 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO nova.api.openstack.requestlog [None req-3e39b4ad-be0c-42eb-81a4-8dca1b410d8f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.490967 Aug 31 01:15:30.570912 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: [pid: 105993|app: 0|req: 15/28] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Aug 31 01:15:30 2022] POST /compute/v2.1/flavors => generated 406 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 01:15:30.584080 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi [None req-2f5b0eec-c3c9-4bc6-a205-38fd86d8fdd7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:15:30.653624 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: INFO nova.api.openstack.requestlog [None req-2f5b0eec-c3c9-4bc6-a205-38fd86d8fdd7 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074045 Aug 31 01:15:30.654233 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: [pid: 105994|app: 0|req: 14/29] 10.222.0.20 () {64 vars in 1333 bytes} [Wed Aug 31 01:15:30 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:15:33.141474 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi [None req-3e39b4ad-be0c-42eb-81a4-8dca1b410d8f admin admin] Calling method '>' {{(pid=105993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:15:33.142473 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO nova.api.openstack.requestlog [None req-3e39b4ad-be0c-42eb-81a4-8dca1b410d8f admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Aug 31 01:15:33.142893 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: [pid: 105993|app: 0|req: 16/30] 10.222.0.20 () {54 vars in 931 bytes} [Wed Aug 31 01:15:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:15:33.593224 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi [None req-da9c1076-3c76-4821-82e5-4f3b767aa8f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 8192, "id": "4", "vcpus": 4, "name": "m1.large", "swap": 0, "rxtx_factor": 1.0, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:15:33.600232 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG dbcounter [-] [105994] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:15:33.678538 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: INFO nova.api.openstack.requestlog [None req-da9c1076-3c76-4821-82e5-4f3b767aa8f9 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.529722 Aug 31 01:15:33.679549 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: [pid: 105994|app: 0|req: 15/31] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Aug 31 01:15:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 01:15:33.691581 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi [None req-2cdc8b7a-34b8-4bd4-8ef7-2c34f67ebb4b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:15:33.785135 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO nova.api.openstack.requestlog [None req-2cdc8b7a-34b8-4bd4-8ef7-2c34f67ebb4b admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097064 Aug 31 01:15:33.785978 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: [pid: 105993|app: 0|req: 17/32] 10.222.0.20 () {64 vars in 1333 bytes} [Wed Aug 31 01:15:33 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:15:36.131743 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi [None req-da9c1076-3c76-4821-82e5-4f3b767aa8f9 admin admin] Calling method '>' {{(pid=105994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:15:36.133678 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: INFO nova.api.openstack.requestlog [None req-da9c1076-3c76-4821-82e5-4f3b767aa8f9 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002724 Aug 31 01:15:36.134552 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: [pid: 105994|app: 0|req: 16/33] 10.222.0.20 () {54 vars in 931 bytes} [Wed Aug 31 01:15:36 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:15:36.623901 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi [None req-39fb8a47-1656-44b7-a015-14840576ea4d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 16384, "disk": 160, "id": "5", "vcpus": 8, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.xlarge"}} {{(pid=105993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:15:36.679446 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO nova.api.openstack.requestlog [None req-39fb8a47-1656-44b7-a015-14840576ea4d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.538686 Aug 31 01:15:36.680114 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: [pid: 105993|app: 0|req: 18/34] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Aug 31 01:15:36 2022] POST /compute/v2.1/flavors => generated 408 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 01:15:36.692528 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi [None req-e9275843-f1e2-49bc-8734-65aa19a6a57b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:15:36.775932 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: INFO nova.api.openstack.requestlog [None req-e9275843-f1e2-49bc-8734-65aa19a6a57b admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087049 Aug 31 01:15:36.777171 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: [pid: 105994|app: 0|req: 17/35] 10.222.0.20 () {64 vars in 1333 bytes} [Wed Aug 31 01:15:36 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:15:55.922953 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi [None req-39fb8a47-1656-44b7-a015-14840576ea4d admin admin] Calling method '>' {{(pid=105993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:15:55.923997 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO nova.api.openstack.requestlog [None req-39fb8a47-1656-44b7-a015-14840576ea4d admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Aug 31 01:15:55.924399 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: [pid: 105993|app: 0|req: 19/36] 10.222.0.20 () {54 vars in 931 bytes} [Wed Aug 31 01:15:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:15:56.307729 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi [None req-7e12cf8d-c9a3-4fa5-b44d-03157ed6602d admin admin] Calling method '>' {{(pid=105994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:15:56.327199 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: INFO nova.api.openstack.requestlog [None req-7e12cf8d-c9a3-4fa5-b44d-03157ed6602d admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.396629 Aug 31 01:15:56.327719 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: [pid: 105994|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1292 bytes} [Wed Aug 31 01:15:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:15:57.379801 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi [None req-39fb8a47-1656-44b7-a015-14840576ea4d admin admin] Calling method '>' {{(pid=105993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:15:57.380828 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO nova.api.openstack.requestlog [None req-39fb8a47-1656-44b7-a015-14840576ea4d admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Aug 31 01:15:57.381228 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: [pid: 105993|app: 0|req: 20/38] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 31 01:15:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:15:57.897059 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi [None req-43b93646-042c-43a7-87bc-baa4075b5343 admin admin] Calling method '>' {{(pid=105994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:15:57.902309 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: INFO nova.api.openstack.wsgi [None req-43b93646-042c-43a7-87bc-baa4075b5343 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 01:15:57.905556 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi [None req-43b93646-042c-43a7-87bc-baa4075b5343 admin admin] Request method failure captured: Aug 31 01:15:57.905556 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 01:15:57.905556 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: Accept: application/json Aug 31 01:15:57.905556 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: Accept-Encoding: gzip, deflate Aug 31 01:15:57.905556 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: Connection: keep-alive Aug 31 01:15:57.905556 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: Content-Length: 0 Aug 31 01:15:57.905556 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: Host: 10.222.0.20 Aug 31 01:15:57.905556 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: Openstack-Api-Version: compute 2.90 Aug 31 01:15:57.905556 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: Openstack-System-Scope: None Aug 31 01:15:57.905556 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: User-Agent: python-novaclient Aug 31 01:15:57.905556 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Auth-Token: gAAAAABjDrZNim2p-H0HIvj-QXeT09u2IfYSPcto7LbwkkfCcZw8NCvalyY4vAzrYRwJHhFXMpdRJB9a4ZE_KG3y4qFLngcLzMA0LyutQg3ZUwWf4SlIVjXPTY150uvR8mx4o_2iotqFwIUXzUZXjOXGDtGjz0cBTNp7FlAyJPFXorr0XjCr9xI Aug 31 01:15:57.905556 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Domain-Id: None Aug 31 01:15:57.905556 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Domain-Name: None Aug 31 01:15:57.905556 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Identity-Status: Confirmed Aug 31 01:15:57.905556 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Is-Admin-Project: True Aug 31 01:15:57.905556 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 01:15:57.905556 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Project-Domain-Id: default Aug 31 01:15:57.905556 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Project-Domain-Name: Default Aug 31 01:15:57.905556 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Project-Id: 77c8e2846a11431eb786ad3a5192ea92 Aug 31 01:15:57.905556 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Project-Name: admin Aug 31 01:15:57.905556 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Role: member,admin,reader Aug 31 01:15:57.905556 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Roles: member,admin,reader Aug 31 01:15:57.907194 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/77c8e2846a11431eb786ad3a5192ea92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_77c8e2846a11431eb786ad3a5192ea92", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/77c8e2846a11431eb786ad3a5192ea92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/77c8e2846a11431eb786ad3a5192ea92"}]}] Aug 31 01:15:57.907194 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Tenant: admin Aug 31 01:15:57.907194 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Tenant-Id: 77c8e2846a11431eb786ad3a5192ea92 Aug 31 01:15:57.907194 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Tenant-Name: admin Aug 31 01:15:57.907194 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-User: admin Aug 31 01:15:57.907194 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-User-Domain-Id: default Aug 31 01:15:57.907194 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-User-Domain-Name: Default Aug 31 01:15:57.907194 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-User-Id: 7772468996d2491aa2e6bc53000efa74 Aug 31 01:15:57.907194 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-User-Name: admin Aug 31 01:15:57.907194 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: method: > Aug 31 01:15:57.907194 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: exception: Flavor 42 could not be found. Aug 31 01:15:57.907194 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: action_args: {'id': '42'} Aug 31 01:15:57.907194 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: {{(pid=105994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:15:57.907194 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:15:57.908932 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 01:15:57.908932 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 01:15:57.908932 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 01:15:57.908932 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 01:15:57.908932 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 01:15:57.908932 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 01:15:57.908932 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 01:15:57.908932 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 01:15:57.908932 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 01:15:57.908932 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:15:57.908932 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 01:15:57.908932 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 01:15:57.908932 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 01:15:57.908932 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi Aug 31 01:15:57.908932 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:15:57.908932 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi Aug 31 01:15:57.908932 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:15:57.908932 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:15:57.908932 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:15:57.910301 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:15:57.910301 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:15:57.910301 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:15:57.910301 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:15:57.910301 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 01:15:57.910301 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:15:57.910301 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 01:15:57.910301 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi Aug 31 01:15:57.910301 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:15:57.910301 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi Aug 31 01:15:57.910301 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:15:57.910301 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:15:57.910301 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:15:57.910301 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:15:57.910301 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:15:57.910301 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 01:15:57.910301 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi Aug 31 01:15:57.910301 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi [None req-43b93646-042c-43a7-87bc-baa4075b5343 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:15:57.911621 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: INFO nova.api.openstack.requestlog [None req-43b93646-042c-43a7-87bc-baa4075b5343 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.389329 Aug 31 01:15:57.911621 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: [pid: 105994|app: 0|req: 19/39] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Aug 31 01:15:57 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 01:15:57.917175 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi [None req-56cf3b1f-3b07-4e71-95c1-0c883b3622bb admin admin] Calling method '>' {{(pid=105993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:15:57.921344 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG dbcounter [-] [105993] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:15:57.940875 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO nova.api.openstack.requestlog [None req-56cf3b1f-3b07-4e71-95c1-0c883b3622bb admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027207 Aug 31 01:15:57.941397 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: [pid: 105993|app: 0|req: 21/40] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Aug 31 01:15:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:15:57.951039 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi [None req-e4c61d54-77af-4a04-89af-fab6de70e443 admin admin] Calling method '>' {{(pid=105994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:15:57.975327 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: INFO nova.api.openstack.requestlog [None req-e4c61d54-77af-4a04-89af-fab6de70e443 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027792 Aug 31 01:15:57.975903 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: [pid: 105994|app: 0|req: 20/41] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Aug 31 01:15:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:15:57.985638 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi [None req-1a012301-5c47-4279-bd81-edaee621c8f5 admin admin] Calling method '>' {{(pid=105993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:15:57.991639 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO nova.api.openstack.wsgi [None req-1a012301-5c47-4279-bd81-edaee621c8f5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 01:15:57.994970 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi [None req-1a012301-5c47-4279-bd81-edaee621c8f5 admin admin] Request method failure captured: Aug 31 01:15:57.994970 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 01:15:57.994970 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: Accept: application/json Aug 31 01:15:57.994970 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: Accept-Encoding: gzip, deflate Aug 31 01:15:57.994970 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: Connection: keep-alive Aug 31 01:15:57.994970 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: Content-Length: 0 Aug 31 01:15:57.994970 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: Host: 10.222.0.20 Aug 31 01:15:57.994970 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: Openstack-Api-Version: compute 2.90 Aug 31 01:15:57.994970 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: Openstack-System-Scope: None Aug 31 01:15:57.994970 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: User-Agent: python-novaclient Aug 31 01:15:57.994970 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Auth-Token: gAAAAABjDrZNim2p-H0HIvj-QXeT09u2IfYSPcto7LbwkkfCcZw8NCvalyY4vAzrYRwJHhFXMpdRJB9a4ZE_KG3y4qFLngcLzMA0LyutQg3ZUwWf4SlIVjXPTY150uvR8mx4o_2iotqFwIUXzUZXjOXGDtGjz0cBTNp7FlAyJPFXorr0XjCr9xI Aug 31 01:15:57.994970 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Domain-Id: None Aug 31 01:15:57.994970 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Domain-Name: None Aug 31 01:15:57.994970 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Identity-Status: Confirmed Aug 31 01:15:57.994970 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Is-Admin-Project: True Aug 31 01:15:57.994970 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 01:15:57.994970 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Project-Domain-Id: default Aug 31 01:15:57.994970 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Project-Domain-Name: Default Aug 31 01:15:57.994970 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Project-Id: 77c8e2846a11431eb786ad3a5192ea92 Aug 31 01:15:57.994970 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Project-Name: admin Aug 31 01:15:57.994970 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Role: member,admin,reader Aug 31 01:15:57.994970 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Roles: member,admin,reader Aug 31 01:15:58.001261 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/77c8e2846a11431eb786ad3a5192ea92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_77c8e2846a11431eb786ad3a5192ea92", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/77c8e2846a11431eb786ad3a5192ea92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/77c8e2846a11431eb786ad3a5192ea92"}]}] Aug 31 01:15:58.001261 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Tenant: admin Aug 31 01:15:58.001261 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Tenant-Id: 77c8e2846a11431eb786ad3a5192ea92 Aug 31 01:15:58.001261 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Tenant-Name: admin Aug 31 01:15:58.001261 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-User: admin Aug 31 01:15:58.001261 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-User-Domain-Id: default Aug 31 01:15:58.001261 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-User-Domain-Name: Default Aug 31 01:15:58.001261 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-User-Id: 7772468996d2491aa2e6bc53000efa74 Aug 31 01:15:58.001261 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-User-Name: admin Aug 31 01:15:58.001261 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: method: > Aug 31 01:15:58.001261 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: exception: Flavor 42 could not be found. Aug 31 01:15:58.001261 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: action_args: {'id': '42'} Aug 31 01:15:58.001261 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: {{(pid=105993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:15:58.001261 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:15:58.002120 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 01:15:58.002120 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 01:15:58.002120 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 01:15:58.002120 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 01:15:58.002120 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 01:15:58.002120 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 01:15:58.002120 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 01:15:58.002120 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 01:15:58.002120 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 01:15:58.002120 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:15:58.002120 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 01:15:58.002120 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 01:15:58.002120 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 01:15:58.002120 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi Aug 31 01:15:58.002120 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:15:58.002120 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi Aug 31 01:15:58.002120 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:15:58.002120 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:15:58.002120 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:15:58.003165 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:15:58.003165 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:15:58.003165 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:15:58.003165 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:15:58.003165 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 01:15:58.003165 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:15:58.003165 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 01:15:58.003165 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi Aug 31 01:15:58.003165 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:15:58.003165 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi Aug 31 01:15:58.003165 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:15:58.003165 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:15:58.003165 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:15:58.003165 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:15:58.003165 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:15:58.003165 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 01:15:58.003165 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi Aug 31 01:15:58.003165 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi [None req-1a012301-5c47-4279-bd81-edaee621c8f5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:15:58.004232 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO nova.api.openstack.requestlog [None req-1a012301-5c47-4279-bd81-edaee621c8f5 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014617 Aug 31 01:15:58.004232 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: [pid: 105993|app: 0|req: 22/42] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Aug 31 01:15:57 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 31 01:15:58.971936 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi [None req-e4c61d54-77af-4a04-89af-fab6de70e443 admin admin] Calling method '>' {{(pid=105994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:15:58.973007 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: INFO nova.api.openstack.requestlog [None req-e4c61d54-77af-4a04-89af-fab6de70e443 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 31 01:15:58.973396 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: [pid: 105994|app: 0|req: 21/43] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 31 01:15:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:15:59.490746 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi [None req-94493f23-5c9b-4706-addd-883ea0507629 admin admin] Calling method '>' {{(pid=105993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:15:59.496555 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO nova.api.openstack.wsgi [None req-94493f23-5c9b-4706-addd-883ea0507629 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 01:15:59.498077 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi [None req-94493f23-5c9b-4706-addd-883ea0507629 admin admin] Request method failure captured: Aug 31 01:15:59.498077 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 01:15:59.498077 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: Accept: application/json Aug 31 01:15:59.498077 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: Accept-Encoding: gzip, deflate Aug 31 01:15:59.498077 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: Connection: keep-alive Aug 31 01:15:59.498077 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: Content-Length: 0 Aug 31 01:15:59.498077 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: Host: 10.222.0.20 Aug 31 01:15:59.498077 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: Openstack-Api-Version: compute 2.90 Aug 31 01:15:59.498077 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: Openstack-System-Scope: None Aug 31 01:15:59.498077 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: User-Agent: python-novaclient Aug 31 01:15:59.498077 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Auth-Token: gAAAAABjDrZOjdS7HrukOnY0G4jJMtXXLsmQCfWp-nzkVzTnF7wABVVKohmofo8c5h7ORC_-6-aVkjozmde4r5ER8rU20BXZablS0AxwJI8pqpRhnF7GDYxc5_l5lRWU96zuF5ZLjACu6qUuSCzExMNNVY9sfO-TeQJyAaK_sROuyxsw2Q0YYx8 Aug 31 01:15:59.498077 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Domain-Id: None Aug 31 01:15:59.498077 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Domain-Name: None Aug 31 01:15:59.498077 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Identity-Status: Confirmed Aug 31 01:15:59.498077 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Is-Admin-Project: True Aug 31 01:15:59.498077 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 01:15:59.498077 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Project-Domain-Id: default Aug 31 01:15:59.498077 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Project-Domain-Name: Default Aug 31 01:15:59.498077 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Project-Id: 77c8e2846a11431eb786ad3a5192ea92 Aug 31 01:15:59.498077 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Project-Name: admin Aug 31 01:15:59.498077 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Role: member,admin,reader Aug 31 01:15:59.498077 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Roles: member,admin,reader Aug 31 01:15:59.499620 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/77c8e2846a11431eb786ad3a5192ea92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_77c8e2846a11431eb786ad3a5192ea92", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/77c8e2846a11431eb786ad3a5192ea92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/77c8e2846a11431eb786ad3a5192ea92"}]}] Aug 31 01:15:59.499620 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Tenant: admin Aug 31 01:15:59.499620 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Tenant-Id: 77c8e2846a11431eb786ad3a5192ea92 Aug 31 01:15:59.499620 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Tenant-Name: admin Aug 31 01:15:59.499620 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-User: admin Aug 31 01:15:59.499620 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-User-Domain-Id: default Aug 31 01:15:59.499620 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-User-Domain-Name: Default Aug 31 01:15:59.499620 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-User-Id: 7772468996d2491aa2e6bc53000efa74 Aug 31 01:15:59.499620 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-User-Name: admin Aug 31 01:15:59.499620 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: method: > Aug 31 01:15:59.499620 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: exception: Flavor 84 could not be found. Aug 31 01:15:59.499620 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: action_args: {'id': '84'} Aug 31 01:15:59.499620 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: {{(pid=105993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:15:59.499620 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:15:59.500516 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 01:15:59.500516 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 01:15:59.500516 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 01:15:59.500516 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 01:15:59.500516 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 01:15:59.500516 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 01:15:59.500516 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 01:15:59.500516 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 01:15:59.500516 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 01:15:59.500516 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:15:59.500516 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 01:15:59.500516 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 01:15:59.500516 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 01:15:59.500516 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi Aug 31 01:15:59.500516 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:15:59.500516 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi Aug 31 01:15:59.500516 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:15:59.500516 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:15:59.500516 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:15:59.502015 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:15:59.502015 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:15:59.502015 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:15:59.502015 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:15:59.502015 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 01:15:59.502015 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:15:59.502015 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 01:15:59.502015 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi Aug 31 01:15:59.502015 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:15:59.502015 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi Aug 31 01:15:59.502015 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:15:59.502015 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:15:59.502015 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:15:59.502015 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:15:59.502015 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:15:59.502015 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 01:15:59.502015 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi Aug 31 01:15:59.502015 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi [None req-94493f23-5c9b-4706-addd-883ea0507629 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:15:59.503345 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO nova.api.openstack.requestlog [None req-94493f23-5c9b-4706-addd-883ea0507629 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.389994 Aug 31 01:15:59.503345 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: [pid: 105993|app: 0|req: 23/44] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Aug 31 01:15:59 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 01:15:59.509372 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi [None req-ad0f4a1e-3a1e-490f-93c7-39817382e1a9 admin admin] Calling method '>' {{(pid=105994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:15:59.524546 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: INFO nova.api.openstack.requestlog [None req-ad0f4a1e-3a1e-490f-93c7-39817382e1a9 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018757 Aug 31 01:15:59.525100 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: [pid: 105994|app: 0|req: 22/45] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Aug 31 01:15:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 01:15:59.534801 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi [None req-e21787aa-e2d1-433f-97cc-17c2e9bd30c4 admin admin] Calling method '>' {{(pid=105993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:15:59.549460 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO nova.api.openstack.requestlog [None req-e21787aa-e2d1-433f-97cc-17c2e9bd30c4 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018708 Aug 31 01:15:59.550021 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: [pid: 105993|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Aug 31 01:15:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:15:59.558746 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi [None req-4e426706-b676-4c0a-a1b3-c0bae7022d57 admin admin] Calling method '>' {{(pid=105994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:15:59.563876 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: INFO nova.api.openstack.wsgi [None req-4e426706-b676-4c0a-a1b3-c0bae7022d57 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 01:15:59.565385 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi [None req-4e426706-b676-4c0a-a1b3-c0bae7022d57 admin admin] Request method failure captured: Aug 31 01:15:59.565385 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 01:15:59.565385 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: Accept: application/json Aug 31 01:15:59.565385 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: Accept-Encoding: gzip, deflate Aug 31 01:15:59.565385 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: Connection: keep-alive Aug 31 01:15:59.565385 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: Content-Length: 0 Aug 31 01:15:59.565385 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: Host: 10.222.0.20 Aug 31 01:15:59.565385 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: Openstack-Api-Version: compute 2.90 Aug 31 01:15:59.565385 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: Openstack-System-Scope: None Aug 31 01:15:59.565385 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: User-Agent: python-novaclient Aug 31 01:15:59.565385 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Auth-Token: gAAAAABjDrZOjdS7HrukOnY0G4jJMtXXLsmQCfWp-nzkVzTnF7wABVVKohmofo8c5h7ORC_-6-aVkjozmde4r5ER8rU20BXZablS0AxwJI8pqpRhnF7GDYxc5_l5lRWU96zuF5ZLjACu6qUuSCzExMNNVY9sfO-TeQJyAaK_sROuyxsw2Q0YYx8 Aug 31 01:15:59.565385 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Domain-Id: None Aug 31 01:15:59.565385 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Domain-Name: None Aug 31 01:15:59.565385 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Identity-Status: Confirmed Aug 31 01:15:59.565385 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Is-Admin-Project: True Aug 31 01:15:59.565385 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 01:15:59.565385 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Project-Domain-Id: default Aug 31 01:15:59.565385 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Project-Domain-Name: Default Aug 31 01:15:59.565385 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Project-Id: 77c8e2846a11431eb786ad3a5192ea92 Aug 31 01:15:59.565385 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Project-Name: admin Aug 31 01:15:59.565385 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Role: member,admin,reader Aug 31 01:15:59.565385 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Roles: member,admin,reader Aug 31 01:15:59.566927 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/77c8e2846a11431eb786ad3a5192ea92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_77c8e2846a11431eb786ad3a5192ea92", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/77c8e2846a11431eb786ad3a5192ea92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/77c8e2846a11431eb786ad3a5192ea92"}]}] Aug 31 01:15:59.566927 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Tenant: admin Aug 31 01:15:59.566927 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Tenant-Id: 77c8e2846a11431eb786ad3a5192ea92 Aug 31 01:15:59.566927 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Tenant-Name: admin Aug 31 01:15:59.566927 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-User: admin Aug 31 01:15:59.566927 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-User-Domain-Id: default Aug 31 01:15:59.566927 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-User-Domain-Name: Default Aug 31 01:15:59.566927 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-User-Id: 7772468996d2491aa2e6bc53000efa74 Aug 31 01:15:59.566927 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-User-Name: admin Aug 31 01:15:59.566927 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: method: > Aug 31 01:15:59.566927 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: exception: Flavor 84 could not be found. Aug 31 01:15:59.566927 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: action_args: {'id': '84'} Aug 31 01:15:59.566927 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: {{(pid=105994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:15:59.566927 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:15:59.568070 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 01:15:59.568070 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 01:15:59.568070 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 01:15:59.568070 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 01:15:59.568070 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 01:15:59.568070 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 01:15:59.568070 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 01:15:59.568070 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 01:15:59.568070 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 01:15:59.568070 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:15:59.568070 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 01:15:59.568070 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 01:15:59.568070 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 01:15:59.568070 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi Aug 31 01:15:59.568070 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:15:59.568070 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi Aug 31 01:15:59.568070 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:15:59.568070 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:15:59.568070 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:15:59.569367 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:15:59.569367 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:15:59.569367 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:15:59.569367 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:15:59.569367 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 01:15:59.569367 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:15:59.569367 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 01:15:59.569367 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi Aug 31 01:15:59.569367 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:15:59.569367 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi Aug 31 01:15:59.569367 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:15:59.569367 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:15:59.569367 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:15:59.569367 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:15:59.569367 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:15:59.569367 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 01:15:59.569367 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi Aug 31 01:15:59.569367 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi [None req-4e426706-b676-4c0a-a1b3-c0bae7022d57 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:15:59.570636 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: INFO nova.api.openstack.requestlog [None req-4e426706-b676-4c0a-a1b3-c0bae7022d57 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011416 Aug 31 01:15:59.570636 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: [pid: 105994|app: 0|req: 23/47] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Aug 31 01:15:59 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 31 01:16:00.523985 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi [None req-e21787aa-e2d1-433f-97cc-17c2e9bd30c4 admin admin] Calling method '>' {{(pid=105993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:16:00.525019 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO nova.api.openstack.requestlog [None req-e21787aa-e2d1-433f-97cc-17c2e9bd30c4 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Aug 31 01:16:00.525408 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: [pid: 105993|app: 0|req: 25/48] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 31 01:16:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:16:01.042894 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi [None req-824cfd50-7160-4f98-825f-14b1d2136d01 admin admin] Calling method '>' {{(pid=105994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:16:01.048619 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: INFO nova.api.openstack.wsgi [None req-824cfd50-7160-4f98-825f-14b1d2136d01 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 01:16:01.050137 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi [None req-824cfd50-7160-4f98-825f-14b1d2136d01 admin admin] Request method failure captured: Aug 31 01:16:01.050137 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 01:16:01.050137 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: Accept: application/json Aug 31 01:16:01.050137 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: Accept-Encoding: gzip, deflate Aug 31 01:16:01.050137 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: Connection: keep-alive Aug 31 01:16:01.050137 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: Content-Length: 0 Aug 31 01:16:01.050137 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: Host: 10.222.0.20 Aug 31 01:16:01.050137 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: Openstack-Api-Version: compute 2.90 Aug 31 01:16:01.050137 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: Openstack-System-Scope: None Aug 31 01:16:01.050137 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: User-Agent: python-novaclient Aug 31 01:16:01.050137 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Auth-Token: gAAAAABjDrZQcIK1s-i4Ub7FG77KK_W7vfl4fbhrz42rB7eceiq9z_c58z_X-6o1LQiUe7JOuBw2BLCL9bWvB7p9hSJ8j68pVeKrm2wGE-2OKPjuhxDCDiZ7LyVNG7GN4onAoRUbeqYD3iGnA4iHcbOeCOyHxibRTuQnQdzeBPvlLe_CGCE6us4 Aug 31 01:16:01.050137 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Domain-Id: None Aug 31 01:16:01.050137 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Domain-Name: None Aug 31 01:16:01.050137 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Identity-Status: Confirmed Aug 31 01:16:01.050137 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Is-Admin-Project: True Aug 31 01:16:01.050137 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 01:16:01.050137 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Project-Domain-Id: default Aug 31 01:16:01.050137 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Project-Domain-Name: Default Aug 31 01:16:01.050137 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Project-Id: 77c8e2846a11431eb786ad3a5192ea92 Aug 31 01:16:01.050137 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Project-Name: admin Aug 31 01:16:01.050137 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Role: member,admin,reader Aug 31 01:16:01.050137 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Roles: member,admin,reader Aug 31 01:16:01.051662 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/77c8e2846a11431eb786ad3a5192ea92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_77c8e2846a11431eb786ad3a5192ea92", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/77c8e2846a11431eb786ad3a5192ea92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/77c8e2846a11431eb786ad3a5192ea92"}]}] Aug 31 01:16:01.051662 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Tenant: admin Aug 31 01:16:01.051662 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Tenant-Id: 77c8e2846a11431eb786ad3a5192ea92 Aug 31 01:16:01.051662 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-Tenant-Name: admin Aug 31 01:16:01.051662 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-User: admin Aug 31 01:16:01.051662 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-User-Domain-Id: default Aug 31 01:16:01.051662 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-User-Domain-Name: Default Aug 31 01:16:01.051662 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-User-Id: 7772468996d2491aa2e6bc53000efa74 Aug 31 01:16:01.051662 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: X-User-Name: admin Aug 31 01:16:01.051662 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: method: > Aug 31 01:16:01.051662 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: exception: Flavor 451 could not be found. Aug 31 01:16:01.051662 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: action_args: {'id': '451'} Aug 31 01:16:01.051662 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: {{(pid=105994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:16:01.051662 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:16:01.052664 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 01:16:01.052664 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 01:16:01.052664 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 01:16:01.052664 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 01:16:01.052664 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 01:16:01.052664 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 01:16:01.052664 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 01:16:01.052664 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 01:16:01.052664 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 01:16:01.052664 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:16:01.052664 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 01:16:01.052664 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 01:16:01.052664 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 01:16:01.052664 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi Aug 31 01:16:01.052664 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:16:01.052664 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi Aug 31 01:16:01.052664 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:16:01.052664 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:16:01.052664 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:16:01.053976 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:16:01.053976 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:16:01.053976 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:16:01.053976 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:16:01.053976 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 01:16:01.053976 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:16:01.053976 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 01:16:01.053976 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi Aug 31 01:16:01.053976 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:16:01.053976 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi Aug 31 01:16:01.053976 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:16:01.053976 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:16:01.053976 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:16:01.053976 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:16:01.053976 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:16:01.053976 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 01:16:01.053976 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: ERROR nova.api.openstack.wsgi Aug 31 01:16:01.053976 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi [None req-824cfd50-7160-4f98-825f-14b1d2136d01 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:16:01.055217 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: INFO nova.api.openstack.requestlog [None req-824cfd50-7160-4f98-825f-14b1d2136d01 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.387827 Aug 31 01:16:01.055217 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: [pid: 105994|app: 0|req: 24/49] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Aug 31 01:16:00 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 01:16:01.061055 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi [None req-b5689715-f609-4157-841b-70eeaa2d7612 admin admin] Calling method '>' {{(pid=105993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:16:01.075646 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO nova.api.openstack.requestlog [None req-b5689715-f609-4157-841b-70eeaa2d7612 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018157 Aug 31 01:16:01.076149 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: [pid: 105993|app: 0|req: 26/50] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Aug 31 01:16:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:16:01.085626 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi [None req-dbb6490b-7444-432c-83fa-f3cac635a70b admin admin] Calling method '>' {{(pid=105994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:16:01.101050 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: INFO nova.api.openstack.requestlog [None req-dbb6490b-7444-432c-83fa-f3cac635a70b admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018787 Aug 31 01:16:01.101570 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: [pid: 105994|app: 0|req: 25/51] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Aug 31 01:16:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:16:01.110434 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi [None req-2e67c5b2-14b7-4ae2-8853-1464f26dd8ba admin admin] Calling method '>' {{(pid=105993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:16:01.115612 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO nova.api.openstack.wsgi [None req-2e67c5b2-14b7-4ae2-8853-1464f26dd8ba admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 01:16:01.117143 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi [None req-2e67c5b2-14b7-4ae2-8853-1464f26dd8ba admin admin] Request method failure captured: Aug 31 01:16:01.117143 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 01:16:01.117143 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: Accept: application/json Aug 31 01:16:01.117143 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: Accept-Encoding: gzip, deflate Aug 31 01:16:01.117143 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: Connection: keep-alive Aug 31 01:16:01.117143 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: Content-Length: 0 Aug 31 01:16:01.117143 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: Host: 10.222.0.20 Aug 31 01:16:01.117143 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: Openstack-Api-Version: compute 2.90 Aug 31 01:16:01.117143 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: Openstack-System-Scope: None Aug 31 01:16:01.117143 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: User-Agent: python-novaclient Aug 31 01:16:01.117143 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Auth-Token: gAAAAABjDrZQcIK1s-i4Ub7FG77KK_W7vfl4fbhrz42rB7eceiq9z_c58z_X-6o1LQiUe7JOuBw2BLCL9bWvB7p9hSJ8j68pVeKrm2wGE-2OKPjuhxDCDiZ7LyVNG7GN4onAoRUbeqYD3iGnA4iHcbOeCOyHxibRTuQnQdzeBPvlLe_CGCE6us4 Aug 31 01:16:01.117143 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Domain-Id: None Aug 31 01:16:01.117143 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Domain-Name: None Aug 31 01:16:01.117143 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Identity-Status: Confirmed Aug 31 01:16:01.117143 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Is-Admin-Project: True Aug 31 01:16:01.117143 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 01:16:01.117143 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Project-Domain-Id: default Aug 31 01:16:01.117143 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Project-Domain-Name: Default Aug 31 01:16:01.117143 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Project-Id: 77c8e2846a11431eb786ad3a5192ea92 Aug 31 01:16:01.117143 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Project-Name: admin Aug 31 01:16:01.117143 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Role: member,admin,reader Aug 31 01:16:01.117143 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Roles: member,admin,reader Aug 31 01:16:01.118663 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/77c8e2846a11431eb786ad3a5192ea92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_77c8e2846a11431eb786ad3a5192ea92", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/77c8e2846a11431eb786ad3a5192ea92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/77c8e2846a11431eb786ad3a5192ea92"}]}] Aug 31 01:16:01.118663 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Tenant: admin Aug 31 01:16:01.118663 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Tenant-Id: 77c8e2846a11431eb786ad3a5192ea92 Aug 31 01:16:01.118663 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-Tenant-Name: admin Aug 31 01:16:01.118663 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-User: admin Aug 31 01:16:01.118663 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-User-Domain-Id: default Aug 31 01:16:01.118663 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-User-Domain-Name: Default Aug 31 01:16:01.118663 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-User-Id: 7772468996d2491aa2e6bc53000efa74 Aug 31 01:16:01.118663 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: X-User-Name: admin Aug 31 01:16:01.118663 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: method: > Aug 31 01:16:01.118663 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: exception: Flavor 451 could not be found. Aug 31 01:16:01.118663 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: action_args: {'id': '451'} Aug 31 01:16:01.118663 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: {{(pid=105993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:16:01.118663 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:16:01.119640 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 01:16:01.119640 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 01:16:01.119640 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 01:16:01.119640 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 01:16:01.119640 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 01:16:01.119640 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 01:16:01.119640 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 01:16:01.119640 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 01:16:01.119640 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 01:16:01.119640 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:16:01.119640 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 01:16:01.119640 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 01:16:01.119640 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 01:16:01.119640 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi Aug 31 01:16:01.119640 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:16:01.119640 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi Aug 31 01:16:01.119640 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:16:01.119640 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:16:01.119640 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:16:01.121060 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:16:01.121060 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:16:01.121060 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:16:01.121060 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:16:01.121060 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 01:16:01.121060 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:16:01.121060 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 01:16:01.121060 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi Aug 31 01:16:01.121060 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:16:01.121060 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi Aug 31 01:16:01.121060 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:16:01.121060 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:16:01.121060 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:16:01.121060 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:16:01.121060 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:16:01.121060 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 01:16:01.121060 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: ERROR nova.api.openstack.wsgi Aug 31 01:16:01.121060 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi [None req-2e67c5b2-14b7-4ae2-8853-1464f26dd8ba admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:16:01.122327 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO nova.api.openstack.requestlog [None req-2e67c5b2-14b7-4ae2-8853-1464f26dd8ba admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011409 Aug 31 01:16:01.122327 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: [pid: 105993|app: 0|req: 27/52] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Aug 31 01:16:01 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 01:16:02.084632 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi [None req-dbb6490b-7444-432c-83fa-f3cac635a70b admin admin] Calling method '>' {{(pid=105994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:16:02.085680 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: INFO nova.api.openstack.requestlog [None req-dbb6490b-7444-432c-83fa-f3cac635a70b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 31 01:16:02.086076 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: [pid: 105994|app: 0|req: 26/53] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 31 01:16:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:16:02.601305 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi [None req-085910bf-41d7-4d61-a6ce-703e018d9621 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:16:02.663166 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO nova.api.openstack.requestlog [None req-085910bf-41d7-4d61-a6ce-703e018d9621 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.438410 Aug 31 01:16:02.663695 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: [pid: 105993|app: 0|req: 28/54] 10.222.0.20 () {64 vars in 1235 bytes} [Wed Aug 31 01:16:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 01:16:03.644925 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi [None req-dbb6490b-7444-432c-83fa-f3cac635a70b admin admin] Calling method '>' {{(pid=105994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:16:03.645946 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: INFO nova.api.openstack.requestlog [None req-dbb6490b-7444-432c-83fa-f3cac635a70b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 31 01:16:03.646364 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: [pid: 105994|app: 0|req: 27/55] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 31 01:16:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:16:04.167792 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi [None req-eee70f34-876e-40ac-b206-ba60a5dbd579 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:16:04.258312 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO nova.api.openstack.requestlog [None req-eee70f34-876e-40ac-b206-ba60a5dbd579 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.473652 Aug 31 01:16:04.258877 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: [pid: 105993|app: 0|req: 29/56] 10.222.0.20 () {64 vars in 1235 bytes} [Wed Aug 31 01:16:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 01:16:05.225104 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi [None req-dbb6490b-7444-432c-83fa-f3cac635a70b admin admin] Calling method '>' {{(pid=105994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:16:05.226108 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: INFO nova.api.openstack.requestlog [None req-dbb6490b-7444-432c-83fa-f3cac635a70b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Aug 31 01:16:05.226526 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: [pid: 105994|app: 0|req: 28/57] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 31 01:16:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:16:05.750331 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi [None req-60f060de-ea53-430f-a564-654da915be1a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:16:05.813636 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO nova.api.openstack.requestlog [None req-60f060de-ea53-430f-a564-654da915be1a admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.446583 Aug 31 01:16:05.814117 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: [pid: 105993|app: 0|req: 30/58] 10.222.0.20 () {64 vars in 1235 bytes} [Wed Aug 31 01:16:05 2022] POST /compute/v2.1/flavors => generated 407 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 01:16:06.772787 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi [None req-dbb6490b-7444-432c-83fa-f3cac635a70b admin admin] Calling method '>' {{(pid=105994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:16:06.773773 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: INFO nova.api.openstack.requestlog [None req-dbb6490b-7444-432c-83fa-f3cac635a70b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Aug 31 01:16:06.774156 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: [pid: 105994|app: 0|req: 29/59] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 31 01:16:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:16:07.285545 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi [None req-7314b3d0-993e-49f3-a020-589bb2e55c59 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:16:07.373199 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO nova.api.openstack.requestlog [None req-7314b3d0-993e-49f3-a020-589bb2e55c59 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.462509 Aug 31 01:16:07.373666 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: [pid: 105993|app: 0|req: 31/60] 10.222.0.20 () {64 vars in 1235 bytes} [Wed Aug 31 01:16:06 2022] POST /compute/v2.1/flavors => generated 409 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 01:16:08.338185 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi [None req-dbb6490b-7444-432c-83fa-f3cac635a70b admin admin] Calling method '>' {{(pid=105994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:16:08.340000 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: INFO nova.api.openstack.requestlog [None req-dbb6490b-7444-432c-83fa-f3cac635a70b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002213 Aug 31 01:16:08.340429 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: [pid: 105994|app: 0|req: 30/61] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 31 01:16:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:16:08.860568 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi [None req-2336fdbf-1f7a-4b64-a3ac-896b54bb05e3 admin admin] Calling method '>' {{(pid=105993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:16:08.881081 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO nova.api.openstack.requestlog [None req-2336fdbf-1f7a-4b64-a3ac-896b54bb05e3 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.401305 Aug 31 01:16:08.881611 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: [pid: 105993|app: 0|req: 32/62] 10.222.0.20 () {60 vars in 1202 bytes} [Wed Aug 31 01:16:08 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 01:17:01.759502 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi [None req-dbb6490b-7444-432c-83fa-f3cac635a70b admin admin] Calling method '>' {{(pid=105994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:17:01.760449 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: INFO nova.api.openstack.requestlog [None req-dbb6490b-7444-432c-83fa-f3cac635a70b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 31 01:17:01.760876 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: [pid: 105994|app: 0|req: 31/63] 10.222.0.20 () {54 vars in 931 bytes} [Wed Aug 31 01:17:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:17:01.771687 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG dbcounter [-] [105993] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:17:02.147473 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi [None req-5ac0364a-f99a-4994-aec1-7c135a19c1f9 admin admin] Calling method '>' {{(pid=105993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:17:02.167504 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO nova.api.openstack.requestlog [None req-5ac0364a-f99a-4994-aec1-7c135a19c1f9 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.400284 Aug 31 01:17:02.168025 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: [pid: 105993|app: 0|req: 33/64] 10.222.0.20 () {60 vars in 1292 bytes} [Wed Aug 31 01:17:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:17:02.189281 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG dbcounter [-] [105994] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:17:02.192974 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi [None req-bb2ab8a5-5ec5-4002-a827-9b3194862b45 admin admin] Calling method '>' {{(pid=105994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:17:02.200609 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: INFO nova.api.openstack.requestlog [None req-bb2ab8a5-5ec5-4002-a827-9b3194862b45 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013305 Aug 31 01:17:02.202150 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: [pid: 105994|app: 0|req: 32/65] 10.222.0.20 () {60 vars in 1283 bytes} [Wed Aug 31 01:17:02 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:17:02.213590 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi [None req-b4bf2d2d-13a4-4488-bb22-5ca3ec23b16a admin admin] Calling method '>' {{(pid=105993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:17:02.221818 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO nova.api.openstack.requestlog [None req-b4bf2d2d-13a4-4488-bb22-5ca3ec23b16a admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011747 Aug 31 01:17:02.222326 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: [pid: 105993|app: 0|req: 34/66] 10.222.0.20 () {60 vars in 1286 bytes} [Wed Aug 31 01:17:02 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:17:02.233601 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi [None req-4cd91eda-5c68-4d07-8e39-835586daeda7 admin admin] Calling method '>' {{(pid=105994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:17:02.242089 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: INFO nova.api.openstack.requestlog [None req-4cd91eda-5c68-4d07-8e39-835586daeda7 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011999 Aug 31 01:17:02.242604 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: [pid: 105994|app: 0|req: 33/67] 10.222.0.20 () {60 vars in 1286 bytes} [Wed Aug 31 01:17:02 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:17:02.254264 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi [None req-a4336ce8-331b-4655-8293-95fc38dd5668 admin admin] Calling method '>' {{(pid=105993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:17:02.262129 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO nova.api.openstack.requestlog [None req-a4336ce8-331b-4655-8293-95fc38dd5668 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011882 Aug 31 01:17:02.262627 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: [pid: 105993|app: 0|req: 35/68] 10.222.0.20 () {60 vars in 1283 bytes} [Wed Aug 31 01:17:02 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:20:27.181788 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi [None req-4cd91eda-5c68-4d07-8e39-835586daeda7 admin admin] Calling method '>' {{(pid=105994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:20:27.182811 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: INFO nova.api.openstack.requestlog [None req-4cd91eda-5c68-4d07-8e39-835586daeda7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Aug 31 01:20:27.183196 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: [pid: 105994|app: 0|req: 34/69] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 31 01:20:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:20:27.322213 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG dbcounter [-] [105993] Writing DB stats nova_api:SELECT=6 {{(pid=105993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:20:27.478299 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi [None req-b7dd782d-4f43-4b78-9354-dc3e745b6844 admin admin] Calling method '>' {{(pid=105993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:20:27.481851 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG oslo_concurrency.lockutils [None req-b7dd782d-4f43-4b78-9354-dc3e745b6844 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:20:27.482349 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG oslo_concurrency.lockutils [None req-b7dd782d-4f43-4b78-9354-dc3e745b6844 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:20:27.482769 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG oslo_concurrency.lockutils [None req-b7dd782d-4f43-4b78-9354-dc3e745b6844 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:20:27.483485 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG oslo_concurrency.lockutils [None req-b7dd782d-4f43-4b78-9354-dc3e745b6844 admin admin] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:20:27.483920 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG oslo_concurrency.lockutils [None req-b7dd782d-4f43-4b78-9354-dc3e745b6844 admin admin] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:20:27.484328 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG oslo_concurrency.lockutils [None req-b7dd782d-4f43-4b78-9354-dc3e745b6844 admin admin] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:20:27.518933 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO nova.api.openstack.requestlog [None req-b7dd782d-4f43-4b78-9354-dc3e745b6844 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.198267 Aug 31 01:20:27.519486 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: [pid: 105993|app: 0|req: 36/70] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Aug 31 01:20:27 2022] GET /compute/v2.1/os-services => generated 791 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 01:20:28.339988 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi [None req-4cd91eda-5c68-4d07-8e39-835586daeda7 admin admin] Calling method '>' {{(pid=105994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:20:28.341071 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: INFO nova.api.openstack.requestlog [None req-4cd91eda-5c68-4d07-8e39-835586daeda7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 31 01:20:28.341466 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: [pid: 105994|app: 0|req: 35/71] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 31 01:20:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:20:28.537183 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi [None req-e5140539-6ddd-45f9-a60c-3f21310b9956 admin admin] Calling method '>' {{(pid=105993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:20:28.540764 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG oslo_concurrency.lockutils [None req-e5140539-6ddd-45f9-a60c-3f21310b9956 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:20:28.541273 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG oslo_concurrency.lockutils [None req-e5140539-6ddd-45f9-a60c-3f21310b9956 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:20:28.541702 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG oslo_concurrency.lockutils [None req-e5140539-6ddd-45f9-a60c-3f21310b9956 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:20:28.542412 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG oslo_concurrency.lockutils [None req-e5140539-6ddd-45f9-a60c-3f21310b9956 admin admin] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:20:28.542855 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG oslo_concurrency.lockutils [None req-e5140539-6ddd-45f9-a60c-3f21310b9956 admin admin] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:20:28.543270 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG oslo_concurrency.lockutils [None req-e5140539-6ddd-45f9-a60c-3f21310b9956 admin admin] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:20:28.562864 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO nova.api.openstack.requestlog [None req-e5140539-6ddd-45f9-a60c-3f21310b9956 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.079012 Aug 31 01:20:28.563349 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: [pid: 105993|app: 0|req: 37/72] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Aug 31 01:20:28 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 01:20:39.796410 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi [None req-4cd91eda-5c68-4d07-8e39-835586daeda7 admin admin] Calling method '>' {{(pid=105994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:20:39.797438 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: INFO nova.api.openstack.requestlog [None req-4cd91eda-5c68-4d07-8e39-835586daeda7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Aug 31 01:20:39.797824 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: [pid: 105994|app: 0|req: 36/73] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 31 01:20:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:20:39.939011 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG dbcounter [-] [105993] Writing DB stats nova_cell0:SELECT=4 {{(pid=105993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:20:39.939740 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG dbcounter [-] [105993] Writing DB stats nova_cell1:SELECT=4 {{(pid=105993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:20:39.940376 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG dbcounter [-] [105993] Writing DB stats nova_api:SELECT=8 {{(pid=105993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:20:39.988006 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi [None req-6c72911d-60ab-4806-9d65-7e60f72f565c admin admin] Calling method '>' {{(pid=105993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:20:39.991398 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG oslo_concurrency.lockutils [None req-6c72911d-60ab-4806-9d65-7e60f72f565c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:20:39.991902 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG oslo_concurrency.lockutils [None req-6c72911d-60ab-4806-9d65-7e60f72f565c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:20:39.992321 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG oslo_concurrency.lockutils [None req-6c72911d-60ab-4806-9d65-7e60f72f565c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:20:39.993049 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG oslo_concurrency.lockutils [None req-6c72911d-60ab-4806-9d65-7e60f72f565c admin admin] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:20:39.993515 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG oslo_concurrency.lockutils [None req-6c72911d-60ab-4806-9d65-7e60f72f565c admin admin] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:20:39.993925 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG oslo_concurrency.lockutils [None req-6c72911d-60ab-4806-9d65-7e60f72f565c admin admin] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:20:40.019087 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO nova.api.openstack.requestlog [None req-6c72911d-60ab-4806-9d65-7e60f72f565c admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.084423 Aug 31 01:20:40.019562 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: [pid: 105993|app: 0|req: 38/74] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Aug 31 01:20:39 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:20:40.843434 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: DEBUG nova.api.openstack.wsgi [None req-4cd91eda-5c68-4d07-8e39-835586daeda7 admin admin] Calling method '>' {{(pid=105994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:20:40.844435 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: INFO nova.api.openstack.requestlog [None req-4cd91eda-5c68-4d07-8e39-835586daeda7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Aug 31 01:20:40.844863 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: [pid: 105994|app: 0|req: 37/75] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 31 01:20:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:20:41.037474 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG nova.api.openstack.wsgi [None req-2fc0f4d7-8014-4f00-96cf-326049c5a996 admin admin] Calling method '>' {{(pid=105993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:20:41.042015 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG oslo_concurrency.lockutils [None req-2fc0f4d7-8014-4f00-96cf-326049c5a996 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:20:41.042597 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG oslo_concurrency.lockutils [None req-2fc0f4d7-8014-4f00-96cf-326049c5a996 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:20:41.043087 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG oslo_concurrency.lockutils [None req-2fc0f4d7-8014-4f00-96cf-326049c5a996 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:20:41.043900 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG oslo_concurrency.lockutils [None req-2fc0f4d7-8014-4f00-96cf-326049c5a996 admin admin] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:20:41.044395 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG oslo_concurrency.lockutils [None req-2fc0f4d7-8014-4f00-96cf-326049c5a996 admin admin] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:20:41.044888 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: DEBUG oslo_concurrency.lockutils [None req-2fc0f4d7-8014-4f00-96cf-326049c5a996 admin admin] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:20:41.068200 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: INFO nova.api.openstack.requestlog [None req-2fc0f4d7-8014-4f00-96cf-326049c5a996 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.082587 Aug 31 01:20:41.068680 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: [pid: 105993|app: 0|req: 39/76] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Aug 31 01:20:40 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:21:36.704033 dv-cinder-855288-2-iscsi devstack@n-api.service[105992]: Wed Aug 31 01:21:36 2022 - graceful shutdown triggered... Aug 31 01:21:36.704146 dv-cinder-855288-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 31 01:21:36.705381 dv-cinder-855288-2-iscsi devstack@n-api.service[105993]: Gracefully killing worker 1 (pid: 105993)... Aug 31 01:21:36.705859 dv-cinder-855288-2-iscsi devstack@n-api.service[105994]: Gracefully killing worker 2 (pid: 105994)... Aug 31 01:21:37.705929 dv-cinder-855288-2-iscsi devstack@n-api.service[105992]: worker 1 buried after 1 seconds Aug 31 01:21:37.706487 dv-cinder-855288-2-iscsi devstack@n-api.service[105992]: worker 2 buried after 1 seconds Aug 31 01:21:37.706487 dv-cinder-855288-2-iscsi devstack@n-api.service[105992]: goodbye to uWSGI. Aug 31 01:21:37.707481 dv-cinder-855288-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 31 01:21:37.708055 dv-cinder-855288-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 31 01:21:37.710906 dv-cinder-855288-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 01:21:37.720111 dv-cinder-855288-2-iscsi devstack@n-api.service[121002]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 01:21:37.722116 dv-cinder-855288-2-iscsi devstack@n-api.service[121002]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 01:21:37 2022] *** Aug 31 01:21:37.722116 dv-cinder-855288-2-iscsi devstack@n-api.service[121002]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 01:21:37.722116 dv-cinder-855288-2-iscsi devstack@n-api.service[121002]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 01:21:37.722116 dv-cinder-855288-2-iscsi devstack@n-api.service[121002]: nodename: dv-cinder-855288-2-iscsi Aug 31 01:21:37.722116 dv-cinder-855288-2-iscsi devstack@n-api.service[121002]: machine: x86_64 Aug 31 01:21:37.722116 dv-cinder-855288-2-iscsi devstack@n-api.service[121002]: clock source: unix Aug 31 01:21:37.722116 dv-cinder-855288-2-iscsi devstack@n-api.service[121002]: pcre jit disabled Aug 31 01:21:37.722116 dv-cinder-855288-2-iscsi devstack@n-api.service[121002]: detected number of CPU cores: 4 Aug 31 01:21:37.722116 dv-cinder-855288-2-iscsi devstack@n-api.service[121002]: current working directory: / Aug 31 01:21:37.722116 dv-cinder-855288-2-iscsi devstack@n-api.service[121002]: detected binary path: /usr/bin/uwsgi-core Aug 31 01:21:37.722116 dv-cinder-855288-2-iscsi devstack@n-api.service[121002]: your processes number limit is 47680 Aug 31 01:21:37.722116 dv-cinder-855288-2-iscsi devstack@n-api.service[121002]: your memory page size is 4096 bytes Aug 31 01:21:37.722116 dv-cinder-855288-2-iscsi devstack@n-api.service[121002]: detected max file descriptor number: 2048 Aug 31 01:21:37.722116 dv-cinder-855288-2-iscsi devstack@n-api.service[121002]: lock engine: pthread robust mutexes Aug 31 01:21:37.723180 dv-cinder-855288-2-iscsi devstack@n-api.service[121002]: thunder lock: enabled Aug 31 01:21:37.723180 dv-cinder-855288-2-iscsi devstack@n-api.service[121002]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 01:21:37.723180 dv-cinder-855288-2-iscsi devstack@n-api.service[121002]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 01:21:37.762243 dv-cinder-855288-2-iscsi devstack@n-api.service[121002]: Python main interpreter initialized at 0x55c2ab6719c0 Aug 31 01:21:37.762243 dv-cinder-855288-2-iscsi devstack@n-api.service[121002]: python threads support enabled Aug 31 01:21:37.762243 dv-cinder-855288-2-iscsi devstack@n-api.service[121002]: your server socket listen backlog is limited to 100 connections Aug 31 01:21:37.762243 dv-cinder-855288-2-iscsi devstack@n-api.service[121002]: your mercy for graceful operations on workers is 90 seconds Aug 31 01:21:37.762696 dv-cinder-855288-2-iscsi devstack@n-api.service[121002]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 01:21:37.762696 dv-cinder-855288-2-iscsi devstack@n-api.service[121002]: *** Operational MODE: preforking *** Aug 31 01:21:37.762946 dv-cinder-855288-2-iscsi devstack@n-api.service[121002]: *** uWSGI is running in multiple interpreter mode *** Aug 31 01:21:37.762946 dv-cinder-855288-2-iscsi devstack@n-api.service[121002]: spawned uWSGI master process (pid: 121002) Aug 31 01:21:37.763166 dv-cinder-855288-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 31 01:21:37.763742 dv-cinder-855288-2-iscsi devstack@n-api.service[121002]: spawned uWSGI worker 1 (pid: 121025, cores: 1) Aug 31 01:21:37.764101 dv-cinder-855288-2-iscsi devstack@n-api.service[121002]: spawned uWSGI worker 2 (pid: 121026, cores: 1) Aug 31 01:21:37.764351 dv-cinder-855288-2-iscsi devstack@n-api.service[121002]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 01:21:38.422230 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 01:21:38.433628 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 01:21:39.574823 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 01:21:39.574823 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: from cryptography.utils import int_from_bytes Aug 31 01:21:39.575431 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 01:21:39.575431 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: from cryptography.utils import int_from_bytes Aug 31 01:21:39.596816 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 01:21:39.596816 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: from cryptography.utils import int_from_bytes Aug 31 01:21:39.597423 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 01:21:39.597423 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: from cryptography.utils import int_from_bytes Aug 31 01:21:41.983771 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 01:21:41.984437 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 01:21:41.984677 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 01:21:41.984997 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 01:21:41.985260 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 01:21:41.985657 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:41.985988 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:41.986313 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:41.986694 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:41.987169 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:41.987487 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:41.987816 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:41.988136 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:41.988468 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:41.988751 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:41.989091 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:41.989430 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855288-2-iscsi {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:41.989757 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:41.990110 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:41.990418 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:41.990775 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:41.991056 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:41.991613 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:41.991928 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:41.992436 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:41.994028 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:41.994028 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:41.994028 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:41.994028 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:41.994392 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:41.994626 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:41.994893 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:41.995207 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:41.995576 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:41.995905 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:41.996306 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855288-2-iscsi {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:41.996630 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:41.996974 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:41.997302 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:41.997749 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:41.998065 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:41.998397 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:41.998690 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:41.999007 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:41.999322 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:41.999730 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.000033 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.000336 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.000653 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.001025 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.001356 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.001658 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.001982 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.002295 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.002604 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.002856 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.003168 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.003495 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.003819 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.004141 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.004397 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.004650 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.005010 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.005333 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.005646 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.006023 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.006262 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.006611 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.006919 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.007228 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.007532 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.007843 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.008163 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.009033 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.009377 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.009884 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.010069 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.010402 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.010639 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.010949 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.011292 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.011614 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.012118 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.012310 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.012711 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.019638 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.019638 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.019638 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.019638 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.019638 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.019638 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.019638 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.019638 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.021487 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.021487 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.021787 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 01:21:42.022544 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.022799 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 01:21:42.022963 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.022963 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.023654 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 01:21:42.023856 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.024120 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 01:21:42.024823 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.024988 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 01:21:42.025146 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.025305 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.025460 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.025613 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.025766 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.025918 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.026078 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.026322 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.026485 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.026485 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.026865 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.027025 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.027186 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.027339 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.027608 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.027770 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.027924 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.028080 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.028235 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.028387 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.028539 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.028693 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.028893 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.029055 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.029210 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855288-2-iscsi {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.029363 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.029523 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.029687 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.029839 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.029990 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.030145 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.030301 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.030463 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.030650 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.030650 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.030650 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.031093 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.031245 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.031406 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.031562 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.031724 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.031925 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.031925 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.032243 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.032410 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.032566 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.032712 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.032903 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.033058 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.033235 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.033771 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.033948 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.034096 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.034240 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.034398 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.034556 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.034702 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.034702 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.034991 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.035143 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.035302 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.035455 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.035603 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.035753 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.035908 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.036059 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.036214 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855288-2-iscsi {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.036455 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.036618 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.036793 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.037038 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.037206 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.037362 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.037508 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.037768 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.037932 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.038098 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.038253 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.038406 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.038558 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.038712 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.038858 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.039019 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.039165 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.039165 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.039447 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.039603 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.039789 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.040065 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.040229 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.040382 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.040536 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.040759 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.040915 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.041080 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.041233 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.041386 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.041539 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.041694 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.041854 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.042041 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.042207 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.042365 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.042511 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.042655 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.042809 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.042965 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.043111 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.043255 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.043400 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.043883 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.044053 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.044213 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.044367 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.044641 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.044827 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.044995 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.045777 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.045777 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.046076 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.046230 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.046388 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.046755 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.046913 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.047159 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.047332 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.047486 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.047638 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.047816 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.048057 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.048229 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.048378 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.048530 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.048685 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.048866 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.049014 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.049166 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.049320 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.049485 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.049646 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.049799 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.049952 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.050098 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.050250 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.050410 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.050569 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.050759 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.050911 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.051058 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.051210 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.051364 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.051534 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.051690 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.051843 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.052032 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.052193 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.052349 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.052504 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.052656 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.052840 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.052999 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.053157 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.053313 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.053475 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.053651 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.054159 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.054310 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.054462 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.054621 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.054775 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.054927 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.055082 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.055238 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.055425 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.055585 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.055739 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.055906 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.056123 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.056284 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.056440 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.056618 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.056867 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.057021 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.057273 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.057425 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.057590 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.057744 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.057897 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.057897 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.057897 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.057897 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.058644 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.058799 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.058978 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.059312 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.059509 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.059672 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.059828 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.059981 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.060179 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.060330 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.060330 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.060622 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.060859 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.061022 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.061176 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.061370 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.061567 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.061733 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.061892 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.062049 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.062202 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.062382 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.062533 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.062684 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.062848 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.063011 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.063166 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.063319 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.063607 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.063758 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.064263 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.064394 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.064547 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.064670 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.064866 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.071470 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.071653 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.071852 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.072049 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.072223 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.072223 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.072509 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.072509 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.072870 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.072870 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.073179 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.073334 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.073488 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.073633 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.073798 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.073971 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.074567 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.074771 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.074923 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.075069 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.075213 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.075382 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.075534 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.075689 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.075870 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.076031 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.076185 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.076420 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.076578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.076755 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.076910 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.077174 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.077334 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.077597 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.077762 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.077921 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.078079 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.078234 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.078389 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.078671 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.078868 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.079021 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.079167 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.079563 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.079730 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.079878 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.080112 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.080267 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.080413 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.080567 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.080765 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.080920 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.081077 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.081277 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.081437 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.081643 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 01:21:42.081800 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.081800 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.082104 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.082283 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.082444 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.082591 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.082746 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.082935 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.083093 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.083257 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.083439 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.083600 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.083756 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.083919 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.084108 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.084281 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.084798 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.084969 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.085127 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.085274 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.085452 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.085605 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.085770 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.085933 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.086087 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.086233 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.086378 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.086592 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.087357 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.087637 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.087804 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.087959 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.088104 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.088256 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.088417 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.088574 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.088851 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.089009 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.089163 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.089317 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.089476 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.089681 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.091170 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.091340 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.091497 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.091719 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.091887 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.092054 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.092332 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.092481 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.092627 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.092892 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.093061 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.093219 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.093404 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.093551 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.093696 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.093851 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.094042 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.094189 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.094392 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.094984 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.094984 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.094984 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.094984 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.094984 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.094984 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.096049 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.096212 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.096212 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.096545 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.096699 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.096889 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.097093 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.097252 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.097570 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.097885 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.098126 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.098255 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.098379 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.098543 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.098663 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.098775 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.099021 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.099177 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.099296 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.099424 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.099547 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.099709 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.099829 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.099942 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.100052 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.100184 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.100298 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.100417 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.100540 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.100698 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.105357 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.105544 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.105702 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.105851 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.106022 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.106253 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.106405 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.106563 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.106718 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.106913 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.107066 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.107221 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.107413 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.107648 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.107921 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.108091 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.108242 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.108388 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.108544 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.108699 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.109033 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.109276 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.109439 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.109594 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.109762 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.109910 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.110068 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.110234 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.110388 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.110543 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.110699 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.110852 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.111033 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.111184 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.111338 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.111526 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.111679 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.111900 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.112061 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.112216 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.112372 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.112528 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.112683 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.112867 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.113016 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.113268 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.113429 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.113590 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.113745 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.113891 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.114044 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.114200 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.114346 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.114515 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.114661 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.114896 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.115288 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.115445 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.115705 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.115860 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.116041 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.116217 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.116445 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.116596 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.116801 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.116975 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.116975 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.117262 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.117415 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.117578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.117848 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.118096 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.118251 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.118407 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.118554 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.118699 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.118699 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.118991 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.119319 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.119566 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.119760 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.119922 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.120110 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.120271 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.120419 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.120571 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.120744 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.120916 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.120916 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.121195 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.121347 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.121505 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.121650 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.121810 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.122000 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.122160 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.122307 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.122307 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.122583 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.122749 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.122896 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.123049 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.123269 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.123433 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.123582 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.123735 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.123889 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.124046 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.124281 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.124441 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.124588 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.124765 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.124945 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.125401 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.125573 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.125731 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.125889 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.126042 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.126188 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.126343 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.126594 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.126756 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.126903 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.127057 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.127202 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.127364 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.127522 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.127711 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.127937 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.127937 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.128359 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.128520 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.128667 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.128873 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.129036 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.129182 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.129411 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.129591 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.129864 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.130053 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.130208 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.130362 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.130531 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.130677 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.130830 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.131019 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.131181 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.131367 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.131528 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.131683 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.131867 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.132063 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.132215 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.132367 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.132526 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.132683 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.132906 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.132906 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.133227 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.133887 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.134084 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.134232 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.134376 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.134376 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.134670 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.134670 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.134960 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.135223 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.135596 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.135752 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.135898 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.136089 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.136281 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.136440 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.136611 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.136852 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.137015 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.137015 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.137349 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.137503 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.137663 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.137808 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.137976 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.138140 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.138377 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.138538 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.138693 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.138847 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.139002 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.139156 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.139427 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.139591 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.139738 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.140005 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.140202 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.140357 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.140503 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.140647 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.140814 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.140976 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.141138 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.141292 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.141439 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.141584 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.141730 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.141875 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.142124 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.142286 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.142445 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.142599 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.142746 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.142900 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.143046 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.143198 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.143380 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.143532 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.143686 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.143841 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.143988 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.144143 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.144358 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.144517 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.144672 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.144872 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.145029 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.145183 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.145441 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.145441 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.145441 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.145441 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.146214 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.146379 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.146535 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.146792 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.147040 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.147207 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.147357 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.147548 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.147698 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.147844 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.147999 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.148152 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.148354 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.148576 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.148759 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.148925 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.149141 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.154365 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.155884 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.156046 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.156211 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.156369 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.156525 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.156717 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.156917 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.157086 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.157244 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.157751 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.157918 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.158087 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.158237 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.158383 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.158528 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.158817 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.158982 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.159139 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.159304 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.159537 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.159689 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.159868 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.160034 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.160183 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.160337 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.160484 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.160702 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.160904 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.168272 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.168447 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.168605 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.168785 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.168939 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.169087 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.169246 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.169402 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.169557 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.169789 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.169943 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.170090 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.170246 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.170410 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.170410 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.170410 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.170410 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.170410 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.171204 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.171463 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.171615 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.172033 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.172233 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.172433 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.172585 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.172585 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.172914 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.173088 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.173326 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.173496 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.173644 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.173799 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.173955 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.174118 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.174272 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.174434 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.174587 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.174749 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.174927 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.175090 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.175277 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.176041 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.176254 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.176423 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.176586 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.176760 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.176932 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.177097 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.177097 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.177097 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.177097 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.177097 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.177097 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.177097 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.177097 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.178656 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.178808 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.178961 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.179158 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.179398 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.179562 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.179716 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.180009 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.180180 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.180407 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.180567 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.180765 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.180938 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.181094 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.181249 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.181411 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.181664 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.181831 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.182100 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.182270 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.182499 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.182670 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.182832 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.182994 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.183147 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.183430 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.183621 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.183778 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.183930 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.184091 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.184244 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.184406 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.184590 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.184770 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.184942 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.185104 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.185257 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.185410 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.185576 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.185731 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.185890 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.186044 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.186197 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.186365 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.186520 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.186683 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.186844 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.187044 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.187205 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.187369 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.187532 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.187686 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.188275 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.188474 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.188635 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.189054 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.189225 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.189420 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.189601 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.189777 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.189946 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.190199 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.190368 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.190571 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.190727 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.190879 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.191041 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.191202 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.191356 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.191583 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.191838 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.192011 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.192292 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.192454 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.192673 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.192870 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.192870 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.193163 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.193339 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.193536 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.193735 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.193956 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.194126 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.194301 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.194463 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.194651 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.194810 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.194963 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.195115 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.195276 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.195436 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.195596 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.195795 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.195795 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.196701 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.196892 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.197067 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.197228 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.197389 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.197389 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.197680 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.197881 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.198057 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.198507 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.198680 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.198878 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.199056 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.199213 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.199366 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.199562 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.199722 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.199908 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.200077 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.200326 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.200489 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.200642 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.200869 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.201025 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.201193 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.201193 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.201499 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.201660 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.201850 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.202073 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.202243 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.202512 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.202720 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.202909 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.203067 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.203235 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.203396 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.203551 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.203711 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.203873 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.204084 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.204610 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.204788 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.204960 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.205122 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.205276 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.205429 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.205590 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.205745 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.205905 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.206057 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.206209 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.206369 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.206547 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.206709 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.206863 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.207049 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.207202 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.207364 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.207519 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.207723 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.207888 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.208074 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.208249 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.208683 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.208969 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.209150 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.209313 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.209467 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.209621 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.209783 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.209937 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.210097 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.210256 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.210505 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.210669 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.210831 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.211022 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.211189 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.211362 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.211572 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.212328 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.212507 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.212813 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.212975 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.213141 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.213294 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.213461 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.213623 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.213790 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.213950 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.214123 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.214318 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.214425 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.214521 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.214616 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.214701 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.214831 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.214926 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.215022 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.215137 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.215223 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.215307 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.215398 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.215493 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.215589 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.215702 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.215802 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.215895 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.216006 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.216100 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.216193 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.216278 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.216378 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.216462 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.216555 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.216647 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.216822 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.216926 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.217020 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.217115 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.217208 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.217293 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.217385 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.217470 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.217553 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.217651 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.217737 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.217821 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.217913 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.217997 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.218089 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.218187 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.218279 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.218364 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.218490 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.218800 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.218890 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.218985 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.219061 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.219132 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.219225 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.219317 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.219416 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.219509 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.219594 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.219678 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.219761 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.219853 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.219949 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.220035 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.220133 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.220226 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.220314 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.220394 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.220503 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.220598 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.220684 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.220795 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.220882 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.220978 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.221075 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.221161 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.221245 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.221336 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.221427 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.221526 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.221612 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.221701 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.221784 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.221867 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.221978 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.222108 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.222206 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.222309 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.222398 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.222481 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.222573 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.222761 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.222850 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.222934 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.223026 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.223125 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.223212 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.223308 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.223394 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.223485 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.223570 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.223654 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.223752 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.223849 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.223934 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.224028 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.224120 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.224212 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.224212 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.224212 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.224212 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.224520 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.224605 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.224688 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.224803 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.224902 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.224989 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.225073 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.225157 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.225254 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.225340 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.225435 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.225527 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.225617 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.225710 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.225804 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.225890 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.225974 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.226065 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.226157 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.226255 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.226349 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.226441 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.226526 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.226618 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.226703 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.226800 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.226886 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.226976 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.227067 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.227189 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.227283 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.227378 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.227473 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.227565 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.227657 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.227748 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.227834 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.227916 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.228002 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.228085 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.228170 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.228261 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.228354 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.228447 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.228533 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.228643 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.228863 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.228961 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.229061 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.229159 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.229245 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.229329 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.229420 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.229512 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.229606 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.229699 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.229791 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.229876 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.229966 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.230057 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.230151 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.230244 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.230336 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.230432 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.230521 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.230620 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.230707 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.230798 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.230890 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.230981 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.231067 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.231163 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.231249 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.231342 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.231437 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.231437 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.231600 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.231692 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.231778 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.231869 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.231959 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.232044 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.232126 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.232223 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.232309 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.232399 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.232399 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.232563 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.232663 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.232819 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.232911 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.233004 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.233090 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.233180 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.233274 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.233359 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.233359 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.233511 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.233602 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.233693 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.233791 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.233876 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.233960 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.234049 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.234140 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.234225 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.234316 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.234402 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.234486 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.234576 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.234667 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.234761 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.234853 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.234944 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.235029 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.235119 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.235210 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.235307 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.235394 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.235484 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.235577 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.235669 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.235754 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.235848 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.235940 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.236024 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.236107 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.236190 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.236286 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.236378 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.236463 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.236554 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.236638 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.236746 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.236852 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.236945 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.237031 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.237115 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.237199 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.237289 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.237382 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.237474 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.237558 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.237642 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.237725 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.237816 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.237910 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.238005 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.238096 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.238188 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.238280 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.238365 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.238457 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.238549 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.238640 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.238726 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.238810 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.239001 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.239106 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.239201 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.239287 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.239372 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.239463 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.239705 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.239822 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.239910 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.240002 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.240088 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.240179 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.240274 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.240368 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.240454 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.240546 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.240633 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.240798 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.240912 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.241009 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.241101 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.241101 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.241256 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.241359 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.241452 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.241548 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.241634 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.241727 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.241810 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.241903 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.241989 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.242073 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.242157 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.242249 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.242341 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.242435 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.242521 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.242521 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.242685 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.243286 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.243389 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.243495 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.243583 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.243675 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.243761 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.243852 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.243952 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.244038 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.244130 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.244215 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.244317 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.244410 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.244513 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.244599 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.244695 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.244824 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.244927 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.245022 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.245116 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.245211 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.245304 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.245397 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.245482 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.245579 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.245666 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.245762 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.245856 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.245944 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.246028 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.246125 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.246125 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.246125 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.246125 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.246125 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.246125 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.246125 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.246125 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.246740 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.246740 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.246740 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.246740 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.246740 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.246740 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.246740 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.246740 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.247366 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.247366 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.247366 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.247366 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.247366 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.247366 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.247366 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.247366 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.248006 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.248006 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.248006 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.248006 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.248006 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.248006 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.248006 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.248006 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.248577 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.248577 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.248577 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.248577 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.248577 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.248577 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.248577 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.248577 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.249369 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.249369 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.249369 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.249369 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.249369 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.249369 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.249369 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.249369 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.249995 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.249995 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.249995 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.249995 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.249995 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.249995 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.249995 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.249995 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.250620 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.250620 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.250620 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.250620 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.250620 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.250620 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.250620 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.250620 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.251228 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.251228 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.251228 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.251228 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.251228 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.251228 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.251228 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.251228 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.251857 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.251857 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.251857 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.251857 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.251857 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.251857 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.251857 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.251857 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.252467 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.252467 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.252467 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.252467 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.252467 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.252467 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.252467 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.252467 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.253097 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.253097 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.253097 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.253097 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.253097 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.253097 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.253097 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.253097 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.253687 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.253687 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.253687 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.253687 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.253687 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.253687 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.253687 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 01:21:42.254228 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.254228 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.254228 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.254228 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.254228 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.254228 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.254228 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.254739 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.254739 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.254739 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.254739 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.254739 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.254739 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.254739 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.254739 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.255311 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.255311 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.255311 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.255311 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.255311 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.255311 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.255311 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.255311 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.256004 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.256004 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.256004 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.256268 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.256596 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.256947 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.257271 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.257602 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.257913 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.258220 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.259169 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.259491 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.259802 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.260131 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.260449 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.260778 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.261158 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.261478 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.262129 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.262484 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.262806 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.263136 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.263465 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.263787 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.264100 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.264428 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.264813 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.265088 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.265407 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.265725 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.266032 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.266338 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.266651 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.266964 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.267271 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.267585 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.267889 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.268278 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.268526 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.268870 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.269179 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.273089 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.273089 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.273089 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.273089 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.273089 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.273089 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.273089 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.273089 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.273803 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.273803 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.273803 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.273803 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.273803 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.273803 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.273803 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.274356 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.274356 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.274577 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.274899 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.275217 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.275530 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.275882 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.276199 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.276742 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.277115 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.277439 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.277771 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.278102 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.278410 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.278716 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.279020 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.279445 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.279661 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.279973 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.280286 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.280600 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.280945 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.281259 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.281570 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.281882 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.282192 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.282502 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.282812 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.283125 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.283434 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.283746 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.284060 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.284400 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.284738 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.285058 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.285374 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.285699 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.286010 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.286317 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.286625 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.286933 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.287248 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.287948 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.287948 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.288167 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.288588 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.288925 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.289245 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.289567 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.290171 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.290284 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.290576 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.290894 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.291213 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.291524 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.291852 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.292235 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.292518 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.292870 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.293178 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.293481 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.293785 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.294094 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.294411 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.294774 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.295021 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.295323 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.295641 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.295945 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.296247 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.296558 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.296877 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.300280 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.300280 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.300280 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.300280 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.300280 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.300280 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.300280 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.300280 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.300948 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.300948 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.300948 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.300948 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.301261 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.301581 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.301930 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.302261 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.302595 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.302918 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.303251 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.303568 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.303896 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.304473 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.304616 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.304852 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.305192 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.306035 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.306350 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.306664 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.306978 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.307290 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO dbcounter [None req-2f35be37-029f-40d7-ba4c-2eb1c8261278 None None] Registered counter for database nova_api Aug 31 01:21:42.307440 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.307583 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.307907 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.308238 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.308546 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.308901 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.309225 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.309544 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.309860 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.310172 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.310500 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.310811 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.311123 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.311433 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.311743 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.312054 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.312370 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.312682 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.313014 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.313343 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.313640 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.313963 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.314287 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.314597 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.314921 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.315246 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.315592 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.315911 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.316252 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.316579 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.316916 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.317230 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.317534 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 01:21:42.317777 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 01:21:42.329963 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_db.sqlalchemy.engines [None req-2f35be37-029f-40d7-ba4c-2eb1c8261278 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121025) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 01:21:42.336551 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writer thread running {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 01:21:42.379564 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO dbcounter [None req-ec196250-bf4f-482b-9512-2f16423045c1 None None] Registered counter for database nova_api Aug 31 01:21:42.392503 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.context [None req-2f35be37-029f-40d7-ba4c-2eb1c8261278 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9(cell1) {{(pid=121025) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 01:21:42.398946 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2f35be37-029f-40d7-ba4c-2eb1c8261278 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:21:42.398946 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2f35be37-029f-40d7-ba4c-2eb1c8261278 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:21:42.398946 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2f35be37-029f-40d7-ba4c-2eb1c8261278 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:21:42.399357 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2f35be37-029f-40d7-ba4c-2eb1c8261278 None None] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:21:42.399740 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2f35be37-029f-40d7-ba4c-2eb1c8261278 None None] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:21:42.400019 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_db.sqlalchemy.engines [None req-ec196250-bf4f-482b-9512-2f16423045c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121026) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 01:21:42.401783 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2f35be37-029f-40d7-ba4c-2eb1c8261278 None None] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:21:42.403799 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO dbcounter [None req-2f35be37-029f-40d7-ba4c-2eb1c8261278 None None] Registered counter for database nova_cell0 Aug 31 01:21:42.406726 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writer thread running {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 01:21:42.407855 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO dbcounter [None req-2f35be37-029f-40d7-ba4c-2eb1c8261278 None None] Registered counter for database nova_cell1 Aug 31 01:21:42.415185 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_db.sqlalchemy.engines [None req-2f35be37-029f-40d7-ba4c-2eb1c8261278 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121025) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 01:21:42.416963 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_db.sqlalchemy.engines [None req-2f35be37-029f-40d7-ba4c-2eb1c8261278 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121025) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 01:21:42.422484 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writer thread running {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 01:21:42.425123 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writer thread running {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 01:21:42.462877 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.context [None req-ec196250-bf4f-482b-9512-2f16423045c1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9(cell1) {{(pid=121026) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 01:21:42.466899 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ec196250-bf4f-482b-9512-2f16423045c1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:21:42.467373 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ec196250-bf4f-482b-9512-2f16423045c1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:21:42.468950 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ec196250-bf4f-482b-9512-2f16423045c1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:21:42.469672 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ec196250-bf4f-482b-9512-2f16423045c1 None None] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:21:42.470117 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ec196250-bf4f-482b-9512-2f16423045c1 None None] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:21:42.472085 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ec196250-bf4f-482b-9512-2f16423045c1 None None] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:21:42.474129 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO dbcounter [None req-ec196250-bf4f-482b-9512-2f16423045c1 None None] Registered counter for database nova_cell0 Aug 31 01:21:42.478114 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO dbcounter [None req-ec196250-bf4f-482b-9512-2f16423045c1 None None] Registered counter for database nova_cell1 Aug 31 01:21:42.486129 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_db.sqlalchemy.engines [None req-ec196250-bf4f-482b-9512-2f16423045c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121026) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 01:21:42.486811 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_db.sqlalchemy.engines [None req-ec196250-bf4f-482b-9512-2f16423045c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121026) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 01:21:42.492200 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writer thread running {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 01:21:42.497943 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writer thread running {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 01:21:42.572138 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO dbcounter [None req-2f35be37-029f-40d7-ba4c-2eb1c8261278 None None] Registered counter for database nova_cell0 Aug 31 01:21:42.578634 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_db.sqlalchemy.engines [None req-2f35be37-029f-40d7-ba4c-2eb1c8261278 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121025) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 01:21:42.583217 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writer thread running {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 01:21:42.640093 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO dbcounter [None req-ec196250-bf4f-482b-9512-2f16423045c1 None None] Registered counter for database nova_cell0 Aug 31 01:21:42.648616 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_db.sqlalchemy.engines [None req-ec196250-bf4f-482b-9512-2f16423045c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121026) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 01:21:42.652959 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writer thread running {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 01:21:42.897565 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: WARNING keystonemiddleware.auth_token [None req-2f35be37-029f-40d7-ba4c-2eb1c8261278 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 01:21:42.904835 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: WARNING keystonemiddleware.auth_token [None req-2f35be37-029f-40d7-ba4c-2eb1c8261278 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 01:21:42.966416 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: WARNING keystonemiddleware.auth_token [None req-ec196250-bf4f-482b-9512-2f16423045c1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 01:21:42.973738 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: WARNING keystonemiddleware.auth_token [None req-ec196250-bf4f-482b-9512-2f16423045c1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 01:21:43.248386 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: WARNING keystonemiddleware.auth_token [None req-2f35be37-029f-40d7-ba4c-2eb1c8261278 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 01:21:43.254435 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: WARNING keystonemiddleware.auth_token [None req-2f35be37-029f-40d7-ba4c-2eb1c8261278 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 01:21:43.259809 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c2ab6719c0 pid: 121025 (default app) Aug 31 01:21:43.319156 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: WARNING keystonemiddleware.auth_token [None req-ec196250-bf4f-482b-9512-2f16423045c1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 01:21:43.325271 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: WARNING keystonemiddleware.auth_token [None req-ec196250-bf4f-482b-9512-2f16423045c1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 01:21:43.330896 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c2ab6719c0 pid: 121026 (default app) Aug 31 01:22:19.388672 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_api:SELECT=3 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:22:19.389805 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell1:SELECT=3 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:22:19.390909 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell0:SELECT=3 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:22:19.391634 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell0:SELECT=3 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:22:20.661964 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-b58cd4fa-662c-4833-8a33-f80ecc5f89fc tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] Action: 'create', calling method: .version_select at 0x7f1fe26f0ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-744258727"}} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:22:21.917451 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-932eda24-d7b1-4fae-8a34-c1b0d06c8e15 tempest-VolumesTestJSON-450118735 tempest-VolumesTestJSON-450118735-project] Calling method '.version_select at 0x7f1fe27cf9d0>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:21.944530 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_api:SELECT=3 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:22:21.945334 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell1:SELECT=3 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:22:21.946128 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell0:SELECT=3 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:22:21.947049 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell0:SELECT=3 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:22:22.381886 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-932eda24-d7b1-4fae-8a34-c1b0d06c8e15 tempest-VolumesTestJSON-450118735 tempest-VolumesTestJSON-450118735-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/01fb2b26-cb6a-4cfa-a781-1ab1c9916d4a" status: 200 len: 351 microversion: 2.1 time: 0.761456 Aug 31 01:22:22.381886 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 1/1] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 31 01:22:21 2022] GET /compute/v2.1/os-volumes/01fb2b26-cb6a-4cfa-a781-1ab1c9916d4a => generated 351 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:22:22.471083 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-b58cd4fa-662c-4833-8a33-f80ecc5f89fc tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.097529 Aug 31 01:22:22.471719 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 1/2] 10.222.0.20 () {60 vars in 1155 bytes} [Wed Aug 31 01:22:19 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3100 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 31 01:22:22.486636 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-6f8dd67e-149d-4c29-991d-24953f192710 tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] Calling method '.version_select at 0x7f1fe25a2f70>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:23.624996 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-6f8dd67e-149d-4c29-991d-24953f192710 tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/08990705-281e-40b7-b810-464a1600bdd8" status: 200 len: 345 microversion: 2.1 time: 1.142608 Aug 31 01:22:23.625846 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 31 01:22:22 2022] GET /compute/v2.1/os-volumes/08990705-281e-40b7-b810-464a1600bdd8 => generated 345 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:22:23.642319 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-9710de74-86bf-4d1a-ba17-2fc8cb0dbd32 tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] Action: 'create', calling method: .version_select at 0x7f1fe2575ca0>, body: {"snapshot": {"volume_id": "08990705-281e-40b7-b810-464a1600bdd8", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-30676169"}} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:22:24.715055 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-9710de74-86bf-4d1a-ba17-2fc8cb0dbd32 tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 1.077125 Aug 31 01:22:24.716435 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 2/4] 10.222.0.20 () {60 vars in 1162 bytes} [Wed Aug 31 01:22:23 2022] POST /compute/v2.1/os-snapshots => generated 285 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:22:24.732185 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-d04cd28b-0aeb-41f4-943e-5eb4357d5595 tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] Calling method '.version_select at 0x7f1fe2569430>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:24.790578 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-d04cd28b-0aeb-41f4-943e-5eb4357d5595 tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/5085e6fb-379b-4ef9-a0f7-7ca4b1d2bd2e" status: 200 len: 285 microversion: 2.1 time: 0.066532 Aug 31 01:22:24.798023 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 3/5] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Aug 31 01:22:24 2022] GET /compute/v2.1/os-snapshots/5085e6fb-379b-4ef9-a0f7-7ca4b1d2bd2e => generated 285 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:22:24.804181 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-c76fc423-11c0-4a90-8e7e-2474a5589c89 tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] Calling method '.version_select at 0x7f1fe258ae50>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:24.857616 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-c76fc423-11c0-4a90-8e7e-2474a5589c89 tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.058241 Aug 31 01:22:24.858453 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 3/6] 10.222.0.20 () {58 vars in 1140 bytes} [Wed Aug 31 01:22:24 2022] GET /compute/v2.1/os-snapshots => generated 288 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:22:24.872000 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-76da978a-5f82-4120-84e5-f6730c02d720 tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] Calling method '.version_select at 0x7f1fe2569af0>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:24.965116 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-8e4340bc-2125-4f93-8604-39699aed1a19 tempest-VolumesTestJSON-450118735 tempest-VolumesTestJSON-450118735-project] Calling method '.version_select at 0x7f1fe258aca0>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:25.051359 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-76da978a-5f82-4120-84e5-f6730c02d720 tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/5085e6fb-379b-4ef9-a0f7-7ca4b1d2bd2e" status: 200 len: 285 microversion: 2.1 time: 0.184797 Aug 31 01:22:25.053869 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Aug 31 01:22:24 2022] GET /compute/v2.1/os-snapshots/5085e6fb-379b-4ef9-a0f7-7ca4b1d2bd2e => generated 285 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:22:25.089794 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-8e4340bc-2125-4f93-8604-39699aed1a19 tempest-VolumesTestJSON-450118735 tempest-VolumesTestJSON-450118735-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/8deb7815-6e0b-45d3-8aad-aa596a75b829" status: 200 len: 350 microversion: 2.1 time: 0.130941 Aug 31 01:22:25.098580 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 31 01:22:24 2022] GET /compute/v2.1/os-volumes/8deb7815-6e0b-45d3-8aad-aa596a75b829 => generated 350 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:22:26.072905 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-68bb8e21-235c-483f-b59b-1335000efdf4 tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] Calling method '.version_select at 0x7f1fe25781f0>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:26.420291 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-68bb8e21-235c-483f-b59b-1335000efdf4 tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/5085e6fb-379b-4ef9-a0f7-7ca4b1d2bd2e" status: 200 len: 285 microversion: 2.1 time: 0.358319 Aug 31 01:22:26.421813 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 5/9] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Aug 31 01:22:26 2022] GET /compute/v2.1/os-snapshots/5085e6fb-379b-4ef9-a0f7-7ca4b1d2bd2e => generated 285 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:22:27.434552 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-0ee7bd48-06c3-41b9-acb5-4607ed488740 tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] Calling method '.version_select at 0x7f1fe258a430>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:27.483137 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-0ee7bd48-06c3-41b9-acb5-4607ed488740 tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/5085e6fb-379b-4ef9-a0f7-7ca4b1d2bd2e" status: 200 len: 285 microversion: 2.1 time: 0.052533 Aug 31 01:22:27.483936 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 5/10] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Aug 31 01:22:27 2022] GET /compute/v2.1/os-snapshots/5085e6fb-379b-4ef9-a0f7-7ca4b1d2bd2e => generated 285 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:22:28.496771 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-1e82841a-7e51-4255-b384-f10f788baf8f tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] Calling method '.version_select at 0x7f1fe25a2ee0>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:28.590888 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-1e82841a-7e51-4255-b384-f10f788baf8f tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/5085e6fb-379b-4ef9-a0f7-7ca4b1d2bd2e" status: 200 len: 286 microversion: 2.1 time: 0.098829 Aug 31 01:22:28.591745 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 6/11] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Aug 31 01:22:28 2022] GET /compute/v2.1/os-snapshots/5085e6fb-379b-4ef9-a0f7-7ca4b1d2bd2e => generated 286 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:22:28.603792 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-6f92dbab-ec82-437d-ac6a-bee7662e6418 tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] Calling method '.version_select at 0x7f1fe2575ca0>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:28.848319 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-6f92dbab-ec82-437d-ac6a-bee7662e6418 tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/5085e6fb-379b-4ef9-a0f7-7ca4b1d2bd2e" status: 202 len: 0 microversion: 2.1 time: 0.249464 Aug 31 01:22:28.849592 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1254 bytes} [Wed Aug 31 01:22:28 2022] DELETE /compute/v2.1/os-snapshots/5085e6fb-379b-4ef9-a0f7-7ca4b1d2bd2e => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 01:22:28.861091 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-7c2c2734-0e61-476c-adda-8824e45fafb2 tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] Calling method '.version_select at 0x7f1fe25780d0>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:28.919763 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-7c2c2734-0e61-476c-adda-8824e45fafb2 tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/5085e6fb-379b-4ef9-a0f7-7ca4b1d2bd2e" status: 200 len: 285 microversion: 2.1 time: 0.064397 Aug 31 01:22:28.920843 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Aug 31 01:22:28 2022] GET /compute/v2.1/os-snapshots/5085e6fb-379b-4ef9-a0f7-7ca4b1d2bd2e => generated 285 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:22:29.225581 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-b06d7ac7-c736-4a9b-8e66-dba6cb9c2aa0 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-70209647", "imageRef": "ed6d3236-defa-4ccf-90ba-343c0d0ad58e", "flavorRef": "452", "networks": [{"uuid": "a27cf704-8eb8-465e-b2ce-81a4020d8b6b"}]}} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:22:29.473221 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.network.neutron [None req-b06d7ac7-c736-4a9b-8e66-dba6cb9c2aa0 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] validate_networks() for [('a27cf704-8eb8-465e-b2ce-81a4020d8b6b', None, None, None, None, None)] {{(pid=121025) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 01:22:29.521507 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-b2239e2a-8ee2-4dc2-b6b0-30991d1444a6 tempest-VolumesTestJSON-450118735 tempest-VolumesTestJSON-450118735-project] Calling method '.version_select at 0x7f1fe2578b80>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:29.662759 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-b2239e2a-8ee2-4dc2-b6b0-30991d1444a6 tempest-VolumesTestJSON-450118735 tempest-VolumesTestJSON-450118735-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/3b9f8a73-b747-4607-a54b-3092e88bebd7" status: 200 len: 351 microversion: 2.1 time: 0.151526 Aug 31 01:22:29.663845 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 8/14] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 31 01:22:29 2022] GET /compute/v2.1/os-volumes/3b9f8a73-b747-4607-a54b-3092e88bebd7 => generated 351 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:22:29.681527 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-ae40dd88-ed97-4582-9a7c-b3657e5b3bcf tempest-VolumesTestJSON-450118735 tempest-VolumesTestJSON-450118735-project] Calling method '.version_select at 0x7f1fe25a2ee0>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:29.835076 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-ae40dd88-ed97-4582-9a7c-b3657e5b3bcf tempest-VolumesTestJSON-450118735 tempest-VolumesTestJSON-450118735-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.162071 Aug 31 01:22:29.835816 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 9/15] 10.222.0.20 () {58 vars in 1134 bytes} [Wed Aug 31 01:22:29 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:22:29.853372 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-aef5f900-c183-43f6-afe8-577859e4f671 tempest-VolumesTestJSON-450118735 tempest-VolumesTestJSON-450118735-project] Calling method '.version_select at 0x7f1fe25a2f70>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:29.976070 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-aef5f900-c183-43f6-afe8-577859e4f671 tempest-VolumesTestJSON-450118735 tempest-VolumesTestJSON-450118735-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.129609 Aug 31 01:22:29.976911 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 10/16] 10.222.0.20 () {58 vars in 1149 bytes} [Wed Aug 31 01:22:29 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:22:29.981432 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-b62a59b7-ec6c-4bf7-978c-fd4a391911c1 tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] Calling method '.version_select at 0x7f1fe25790d0>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:30.037698 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.wsgi [None req-b62a59b7-ec6c-4bf7-978c-fd4a391911c1 tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] HTTP exception thrown: Snapshot 5085e6fb-379b-4ef9-a0f7-7ca4b1d2bd2e could not be found. Aug 31 01:22:30.042883 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-b62a59b7-ec6c-4bf7-978c-fd4a391911c1 tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] Request method failure captured: Aug 31 01:22:30.042883 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: request: GET /compute/v2.1/os-snapshots/5085e6fb-379b-4ef9-a0f7-7ca4b1d2bd2e HTTP/1.1 Aug 31 01:22:30.042883 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept: application/json Aug 31 01:22:30.042883 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept-Encoding: identity Aug 31 01:22:30.042883 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Connection: close Aug 31 01:22:30.042883 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Length: 0 Aug 31 01:22:30.042883 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Type: application/json Aug 31 01:22:30.042883 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Host: 10.222.0.20 Aug 31 01:22:30.042883 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Openstack-System-Scope: None Aug 31 01:22:30.042883 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: User-Agent: python-urllib3/1.26.12 Aug 31 01:22:30.042883 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Auth-Token: gAAAAABjDrfLrrb4Ulw5B5SEPHHcM-x2O4TbdJxT7ApuVHMrlSAE8WqUo4kImwK8hwxFEJX0EuGkohZBAHx2ANENB2Vt7gaM-_573kW6XzHtgwatyzZqlv9YYeQlXTfQ3CUhRu3uNsWhGJbLKCZM8xL2BOndlxB5dnsj0IyNpX89itgopKZI_aw Aug 31 01:22:30.042883 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Id: None Aug 31 01:22:30.042883 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Name: None Aug 31 01:22:30.042883 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Identity-Status: Confirmed Aug 31 01:22:30.042883 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Is-Admin-Project: True Aug 31 01:22:30.042883 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Id: default Aug 31 01:22:30.042883 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Name: Default Aug 31 01:22:30.042883 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Id: 314a7f3b9a1c48e98ff114f51e82ff01 Aug 31 01:22:30.042883 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-342262264 Aug 31 01:22:30.042883 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Role: member,reader Aug 31 01:22:30.042883 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Roles: member,reader Aug 31 01:22:30.046074 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/314a7f3b9a1c48e98ff114f51e82ff01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_314a7f3b9a1c48e98ff114f51e82ff01", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/314a7f3b9a1c48e98ff114f51e82ff01"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/314a7f3b9a1c48e98ff114f51e82ff01"}]}] Aug 31 01:22:30.046074 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant: tempest-VolumesSnapshotsTestJSON-342262264 Aug 31 01:22:30.046074 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Id: 314a7f3b9a1c48e98ff114f51e82ff01 Aug 31 01:22:30.046074 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-342262264 Aug 31 01:22:30.046074 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User: tempest-VolumesSnapshotsTestJSON-342262264-project Aug 31 01:22:30.046074 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Id: default Aug 31 01:22:30.046074 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Name: Default Aug 31 01:22:30.046074 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Id: 8b73724e8e94402d8d18777f57a257e3 Aug 31 01:22:30.046074 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Name: tempest-VolumesSnapshotsTestJSON-342262264-project Aug 31 01:22:30.046074 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: method: Aug 31 01:22:30.046074 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: exception: Snapshot 5085e6fb-379b-4ef9-a0f7-7ca4b1d2bd2e could not be found. Aug 31 01:22:30.046074 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: action_args: {'id': '5085e6fb-379b-4ef9-a0f7-7ca4b1d2bd2e'} Aug 31 01:22:30.046074 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:22:30.046685 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:22:30.046685 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 01:22:30.046685 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 01:22:30.046685 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 01:22:30.046685 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 01:22:30.046685 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 01:22:30.046685 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 01:22:30.046685 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 01:22:30.046685 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 01:22:30.046685 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 01:22:30.046685 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 01:22:30.046685 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 01:22:30.046685 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 01:22:30.046685 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 01:22:30.046685 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 01:22:30.046685 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 5085e6fb-379b-4ef9-a0f7-7ca4b1d2bd2e could not be found. (HTTP 404) (Request-ID: req-a4b519af-7424-4562-b5d6-6db751d7f39a) Aug 31 01:22:30.046685 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:22:30.046685 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:22:30.047487 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:22:30.047487 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:22:30.047487 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 31 01:22:30.047487 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 31 01:22:30.047487 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 01:22:30.047487 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 01:22:30.047487 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 31 01:22:30.047487 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 31 01:22:30.047487 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 01:22:30.047487 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 01:22:30.047487 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 01:22:30.047487 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 01:22:30.047487 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 01:22:30.047487 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 01:22:30.047487 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 01:22:30.047487 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 01:22:30.047487 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 01:22:30.047487 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 01:22:30.047487 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 01:22:30.048352 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 01:22:30.048352 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 01:22:30.048352 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 01:22:30.048352 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 01:22:30.048352 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 01:22:30.048352 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 5085e6fb-379b-4ef9-a0f7-7ca4b1d2bd2e could not be found. Aug 31 01:22:30.048352 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:22:30.048352 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:22:30.048352 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:22:30.048352 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:22:30.048352 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:22:30.048352 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:22:30.048352 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:22:30.048352 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:22:30.048352 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 01:22:30.048352 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 01:22:30.048352 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:22:30.048352 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:22:30.048352 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 31 01:22:30.048352 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:22:30.049379 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 5085e6fb-379b-4ef9-a0f7-7ca4b1d2bd2e could not be found. Aug 31 01:22:30.049379 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:22:30.049379 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:22:30.049379 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:22:30.049379 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:22:30.049379 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:22:30.049379 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:22:30.049379 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:22:30.049379 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:22:30.049379 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 5085e6fb-379b-4ef9-a0f7-7ca4b1d2bd2e could not be found. Aug 31 01:22:30.049379 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:22:30.049379 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-b62a59b7-ec6c-4bf7-978c-fd4a391911c1 tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] Returning 404 to user: Snapshot 5085e6fb-379b-4ef9-a0f7-7ca4b1d2bd2e could not be found. {{(pid=121026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:22:30.049379 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-b62a59b7-ec6c-4bf7-978c-fd4a391911c1 tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/5085e6fb-379b-4ef9-a0f7-7ca4b1d2bd2e" status: 404 len: 111 microversion: 2.1 time: 0.066905 Aug 31 01:22:30.052279 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 11/17] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Aug 31 01:22:29 2022] GET /compute/v2.1/os-snapshots/5085e6fb-379b-4ef9-a0f7-7ca4b1d2bd2e => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:22:30.062777 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-7e9aefd4-157a-483a-bc84-a515c6c45b4e tempest-VolumesTestJSON-450118735 tempest-VolumesTestJSON-450118735-project] Calling method '.version_select at 0x7f1fe2579670>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:30.187776 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-7e9aefd4-157a-483a-bc84-a515c6c45b4e tempest-VolumesTestJSON-450118735 tempest-VolumesTestJSON-450118735-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.134080 Aug 31 01:22:30.188628 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 12/18] 10.222.0.20 () {58 vars in 1134 bytes} [Wed Aug 31 01:22:30 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:22:30.195775 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-d4e4cbd8-53b8-4a39-936c-612b4a343208 tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] Calling method '.version_select at 0x7f1fe24ea8b0>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:30.448810 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-d4e4cbd8-53b8-4a39-936c-612b4a343208 tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/08990705-281e-40b7-b810-464a1600bdd8" status: 202 len: 0 microversion: 2.1 time: 0.258889 Aug 31 01:22:30.450522 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 13/19] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Aug 31 01:22:30 2022] DELETE /compute/v2.1/os-volumes/08990705-281e-40b7-b810-464a1600bdd8 => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 01:22:30.456839 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-92bf4c99-1152-4178-abbb-2e5c1168b631 tempest-VolumesTestJSON-450118735 tempest-VolumesTestJSON-450118735-project] Calling method '.version_select at 0x7f1fe2579ca0>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:30.653385 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-92bf4c99-1152-4178-abbb-2e5c1168b631 tempest-VolumesTestJSON-450118735 tempest-VolumesTestJSON-450118735-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.202728 Aug 31 01:22:30.654656 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 14/20] 10.222.0.20 () {58 vars in 1167 bytes} [Wed Aug 31 01:22:30 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:22:30.663508 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-d6518254-4d4b-4bc2-9288-7d8d738a73bc tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] Calling method '.version_select at 0x7f1fe24ea310>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:30.747898 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-d6518254-4d4b-4bc2-9288-7d8d738a73bc tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/08990705-281e-40b7-b810-464a1600bdd8" status: 200 len: 344 microversion: 2.1 time: 0.092087 Aug 31 01:22:30.749884 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 15/21] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 31 01:22:30 2022] GET /compute/v2.1/os-volumes/08990705-281e-40b7-b810-464a1600bdd8 => generated 344 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:22:30.757237 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-cd1fc165-8cc9-4b50-bea4-8fc0b3ab35f6 tempest-VolumesTestJSON-450118735 tempest-VolumesTestJSON-450118735-project] Calling method '.version_select at 0x7f1fe24f1040>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:30.936436 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-cd1fc165-8cc9-4b50-bea4-8fc0b3ab35f6 tempest-VolumesTestJSON-450118735 tempest-VolumesTestJSON-450118735-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.185266 Aug 31 01:22:30.938224 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 16/22] 10.222.0.20 () {58 vars in 1170 bytes} [Wed Aug 31 01:22:30 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:22:30.952715 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-860eb728-d766-4cdc-a323-ea89b1eae402 tempest-VolumesTestJSON-450118735 tempest-VolumesTestJSON-450118735-project] Calling method '.version_select at 0x7f1fe24ea0d0>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:31.087807 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-860eb728-d766-4cdc-a323-ea89b1eae402 tempest-VolumesTestJSON-450118735 tempest-VolumesTestJSON-450118735-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.139179 Aug 31 01:22:31.088925 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 17/23] 10.222.0.20 () {58 vars in 1155 bytes} [Wed Aug 31 01:22:30 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:22:31.108863 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-7126318d-25f5-4b80-ad90-32def3617a07 tempest-VolumesTestJSON-450118735 tempest-VolumesTestJSON-450118735-project] Calling method '.version_select at 0x7f1fe2579790>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:31.127806 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-b06d7ac7-c736-4a9b-8e66-dba6cb9c2aa0 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Flavor limits 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 01:22:31.128910 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-b06d7ac7-c736-4a9b-8e66-dba6cb9c2aa0 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Image limits 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 01:22:31.129535 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-b06d7ac7-c736-4a9b-8e66-dba6cb9c2aa0 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Flavor pref 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 01:22:31.130762 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-b06d7ac7-c736-4a9b-8e66-dba6cb9c2aa0 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Image pref 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 01:22:31.134401 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-b06d7ac7-c736-4a9b-8e66-dba6cb9c2aa0 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 01:22:31.169565 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b06d7ac7-c736-4a9b-8e66-dba6cb9c2aa0 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:31.173308 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b06d7ac7-c736-4a9b-8e66-dba6cb9c2aa0 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:31.174817 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b06d7ac7-c736-4a9b-8e66-dba6cb9c2aa0 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:31.177065 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b06d7ac7-c736-4a9b-8e66-dba6cb9c2aa0 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:31.180931 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b06d7ac7-c736-4a9b-8e66-dba6cb9c2aa0 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:31.181652 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b06d7ac7-c736-4a9b-8e66-dba6cb9c2aa0 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:31.236704 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.quota [None req-b06d7ac7-c736-4a9b-8e66-dba6cb9c2aa0 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Getting quotas for project 3abb95e8d0a84b76a5d141815451ceae. Resources: {'instances', 'cores', 'ram'} {{(pid=121025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 01:22:31.253972 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.quota [None req-b06d7ac7-c736-4a9b-8e66-dba6cb9c2aa0 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Getting quotas for user b7d058c2b40343a6a3e2e46f6b2bab0e and project 3abb95e8d0a84b76a5d141815451ceae. Resources: {'instances', 'cores', 'ram'} {{(pid=121025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 01:22:31.283595 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-7126318d-25f5-4b80-ad90-32def3617a07 tempest-VolumesTestJSON-450118735 tempest-VolumesTestJSON-450118735-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.183607 Aug 31 01:22:31.293729 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 18/24] 10.222.0.20 () {58 vars in 1188 bytes} [Wed Aug 31 01:22:31 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:22:31.300069 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-af248d73-75ad-4564-b15a-882dddfa1767 tempest-VolumesTestJSON-450118735 tempest-VolumesTestJSON-450118735-project] Calling method '.version_select at 0x7f1fe24f1430>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:31.321282 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-b06d7ac7-c736-4a9b-8e66-dba6cb9c2aa0 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Going to run 1 instances... {{(pid=121025) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 01:22:31.340383 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-b06d7ac7-c736-4a9b-8e66-dba6cb9c2aa0 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] [instance: 3f2e4287-f02a-4d2f-a669-621ae355fce5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ed6d3236-defa-4ccf-90ba-343c0d0ad58e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 01:22:31.443200 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-af248d73-75ad-4564-b15a-882dddfa1767 tempest-VolumesTestJSON-450118735 tempest-VolumesTestJSON-450118735-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.148164 Aug 31 01:22:31.444642 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 19/25] 10.222.0.20 () {58 vars in 1155 bytes} [Wed Aug 31 01:22:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:22:31.705664 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-b06d7ac7-c736-4a9b-8e66-dba6cb9c2aa0 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.604372 Aug 31 01:22:31.709629 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 7/26] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 31 01:22:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 01:22:31.726079 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-fb02993c-3968-4aab-a97a-c1ede1612659 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:31.726885 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-fb02993c-3968-4aab-a97a-c1ede1612659 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] [instance: 3f2e4287-f02a-4d2f-a669-621ae355fce5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:22:31.764313 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-2c3d70d3-bf55-487b-8bb9-7bafc0bd1320 tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] Calling method '.version_select at 0x7f1fe1c18940>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:31.844853 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.wsgi [None req-2c3d70d3-bf55-487b-8bb9-7bafc0bd1320 tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] HTTP exception thrown: Volume 08990705-281e-40b7-b810-464a1600bdd8 could not be found. Aug 31 01:22:31.851032 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-2c3d70d3-bf55-487b-8bb9-7bafc0bd1320 tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] Request method failure captured: Aug 31 01:22:31.851032 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: request: GET /compute/v2.1/os-volumes/08990705-281e-40b7-b810-464a1600bdd8 HTTP/1.1 Aug 31 01:22:31.851032 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept: application/json Aug 31 01:22:31.851032 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept-Encoding: identity Aug 31 01:22:31.851032 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Connection: close Aug 31 01:22:31.851032 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Length: 0 Aug 31 01:22:31.851032 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Type: application/json Aug 31 01:22:31.851032 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Host: 10.222.0.20 Aug 31 01:22:31.851032 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Openstack-System-Scope: None Aug 31 01:22:31.851032 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: User-Agent: python-urllib3/1.26.12 Aug 31 01:22:31.851032 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Auth-Token: gAAAAABjDrfLrrb4Ulw5B5SEPHHcM-x2O4TbdJxT7ApuVHMrlSAE8WqUo4kImwK8hwxFEJX0EuGkohZBAHx2ANENB2Vt7gaM-_573kW6XzHtgwatyzZqlv9YYeQlXTfQ3CUhRu3uNsWhGJbLKCZM8xL2BOndlxB5dnsj0IyNpX89itgopKZI_aw Aug 31 01:22:31.851032 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Id: None Aug 31 01:22:31.851032 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Name: None Aug 31 01:22:31.851032 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Identity-Status: Confirmed Aug 31 01:22:31.851032 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Is-Admin-Project: True Aug 31 01:22:31.851032 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Id: default Aug 31 01:22:31.851032 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Name: Default Aug 31 01:22:31.851032 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Id: 314a7f3b9a1c48e98ff114f51e82ff01 Aug 31 01:22:31.851032 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-342262264 Aug 31 01:22:31.851032 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Role: member,reader Aug 31 01:22:31.851032 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Roles: member,reader Aug 31 01:22:31.853151 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/314a7f3b9a1c48e98ff114f51e82ff01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_314a7f3b9a1c48e98ff114f51e82ff01", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/314a7f3b9a1c48e98ff114f51e82ff01"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/314a7f3b9a1c48e98ff114f51e82ff01"}]}] Aug 31 01:22:31.853151 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant: tempest-VolumesSnapshotsTestJSON-342262264 Aug 31 01:22:31.853151 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Id: 314a7f3b9a1c48e98ff114f51e82ff01 Aug 31 01:22:31.853151 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-342262264 Aug 31 01:22:31.853151 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User: tempest-VolumesSnapshotsTestJSON-342262264-project Aug 31 01:22:31.853151 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Id: default Aug 31 01:22:31.853151 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Name: Default Aug 31 01:22:31.853151 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Id: 8b73724e8e94402d8d18777f57a257e3 Aug 31 01:22:31.853151 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Name: tempest-VolumesSnapshotsTestJSON-342262264-project Aug 31 01:22:31.853151 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: method: Aug 31 01:22:31.853151 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: exception: Volume 08990705-281e-40b7-b810-464a1600bdd8 could not be found. Aug 31 01:22:31.853151 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: action_args: {'id': '08990705-281e-40b7-b810-464a1600bdd8'} Aug 31 01:22:31.853151 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:22:31.853935 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:22:31.853935 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 01:22:31.853935 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 01:22:31.853935 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 01:22:31.853935 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 01:22:31.853935 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 01:22:31.853935 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 01:22:31.853935 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 01:22:31.853935 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 01:22:31.853935 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 01:22:31.853935 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 01:22:31.853935 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 01:22:31.853935 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 01:22:31.853935 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 01:22:31.853935 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 01:22:31.853935 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 08990705-281e-40b7-b810-464a1600bdd8 could not be found. (HTTP 404) (Request-ID: req-16366635-3561-440f-98d7-01a227022815) Aug 31 01:22:31.853935 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:22:31.853935 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:22:31.853935 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:22:31.855018 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:22:31.855018 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 01:22:31.855018 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 01:22:31.855018 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 01:22:31.855018 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 01:22:31.855018 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 01:22:31.855018 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 01:22:31.855018 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 01:22:31.855018 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 01:22:31.855018 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 01:22:31.855018 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 01:22:31.855018 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 01:22:31.855018 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 01:22:31.855018 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 01:22:31.855018 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 01:22:31.855018 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 01:22:31.855018 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 01:22:31.855018 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 01:22:31.855018 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 01:22:31.856125 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 01:22:31.856125 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 01:22:31.856125 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 01:22:31.856125 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 01:22:31.856125 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 08990705-281e-40b7-b810-464a1600bdd8 could not be found. Aug 31 01:22:31.856125 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:22:31.856125 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:22:31.856125 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:22:31.856125 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:22:31.856125 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:22:31.856125 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:22:31.856125 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:22:31.856125 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:22:31.856125 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 01:22:31.856125 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 01:22:31.856125 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:22:31.856125 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:22:31.856125 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 01:22:31.856125 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:22:31.857947 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 08990705-281e-40b7-b810-464a1600bdd8 could not be found. Aug 31 01:22:31.857947 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:22:31.857947 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:22:31.857947 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:22:31.857947 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:22:31.857947 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:22:31.857947 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:22:31.857947 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:22:31.857947 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:22:31.857947 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 08990705-281e-40b7-b810-464a1600bdd8 could not be found. Aug 31 01:22:31.857947 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:22:31.857947 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-2c3d70d3-bf55-487b-8bb9-7bafc0bd1320 tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] Returning 404 to user: Volume 08990705-281e-40b7-b810-464a1600bdd8 could not be found. {{(pid=121025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:22:31.864622 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-2c3d70d3-bf55-487b-8bb9-7bafc0bd1320 tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/08990705-281e-40b7-b810-464a1600bdd8" status: 404 len: 109 microversion: 2.1 time: 0.105731 Aug 31 01:22:31.871440 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 8/27] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 31 01:22:31 2022] GET /compute/v2.1/os-volumes/08990705-281e-40b7-b810-464a1600bdd8 => generated 109 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:22:31.888417 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-c9205be8-79c3-4447-b840-5f2d2fb620d1 tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] Calling method '.version_select at 0x7f1fe2efe310>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:31.973480 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.wsgi [None req-c9205be8-79c3-4447-b840-5f2d2fb620d1 tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] HTTP exception thrown: Volume 08990705-281e-40b7-b810-464a1600bdd8 could not be found. Aug 31 01:22:31.976146 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-c9205be8-79c3-4447-b840-5f2d2fb620d1 tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] Request method failure captured: Aug 31 01:22:31.976146 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: request: DELETE /compute/v2.1/os-volumes/08990705-281e-40b7-b810-464a1600bdd8 HTTP/1.1 Aug 31 01:22:31.976146 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept: application/json Aug 31 01:22:31.976146 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept-Encoding: identity Aug 31 01:22:31.976146 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Connection: close Aug 31 01:22:31.976146 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Length: 0 Aug 31 01:22:31.976146 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Type: application/json Aug 31 01:22:31.976146 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Host: 10.222.0.20 Aug 31 01:22:31.976146 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Openstack-System-Scope: None Aug 31 01:22:31.976146 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: User-Agent: python-urllib3/1.26.12 Aug 31 01:22:31.976146 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Auth-Token: gAAAAABjDrfLrrb4Ulw5B5SEPHHcM-x2O4TbdJxT7ApuVHMrlSAE8WqUo4kImwK8hwxFEJX0EuGkohZBAHx2ANENB2Vt7gaM-_573kW6XzHtgwatyzZqlv9YYeQlXTfQ3CUhRu3uNsWhGJbLKCZM8xL2BOndlxB5dnsj0IyNpX89itgopKZI_aw Aug 31 01:22:31.976146 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Id: None Aug 31 01:22:31.976146 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Name: None Aug 31 01:22:31.976146 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Identity-Status: Confirmed Aug 31 01:22:31.976146 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Is-Admin-Project: True Aug 31 01:22:31.976146 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Id: default Aug 31 01:22:31.976146 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Name: Default Aug 31 01:22:31.976146 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Id: 314a7f3b9a1c48e98ff114f51e82ff01 Aug 31 01:22:31.976146 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-342262264 Aug 31 01:22:31.976146 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Role: member,reader Aug 31 01:22:31.976146 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Roles: member,reader Aug 31 01:22:31.977471 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/314a7f3b9a1c48e98ff114f51e82ff01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_314a7f3b9a1c48e98ff114f51e82ff01", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/314a7f3b9a1c48e98ff114f51e82ff01"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/314a7f3b9a1c48e98ff114f51e82ff01"}]}] Aug 31 01:22:31.977471 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant: tempest-VolumesSnapshotsTestJSON-342262264 Aug 31 01:22:31.977471 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Id: 314a7f3b9a1c48e98ff114f51e82ff01 Aug 31 01:22:31.977471 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-342262264 Aug 31 01:22:31.977471 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User: tempest-VolumesSnapshotsTestJSON-342262264-project Aug 31 01:22:31.977471 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Id: default Aug 31 01:22:31.977471 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Name: Default Aug 31 01:22:31.977471 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Id: 8b73724e8e94402d8d18777f57a257e3 Aug 31 01:22:31.977471 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Name: tempest-VolumesSnapshotsTestJSON-342262264-project Aug 31 01:22:31.977471 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: method: Aug 31 01:22:31.977471 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: exception: Volume 08990705-281e-40b7-b810-464a1600bdd8 could not be found. Aug 31 01:22:31.977471 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: action_args: {'id': '08990705-281e-40b7-b810-464a1600bdd8'} Aug 31 01:22:31.977471 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:22:31.978263 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:22:31.978263 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 01:22:31.978263 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 01:22:31.978263 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 01:22:31.978263 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 01:22:31.978263 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 01:22:31.978263 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 01:22:31.978263 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 01:22:31.978263 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 01:22:31.978263 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 01:22:31.978263 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 01:22:31.978263 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 01:22:31.978263 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 01:22:31.978263 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 01:22:31.978263 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 01:22:31.978263 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 08990705-281e-40b7-b810-464a1600bdd8 could not be found. (HTTP 404) (Request-ID: req-7ee9d0ed-ae49-467d-908e-b2ca0c481253) Aug 31 01:22:31.978263 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:22:31.978263 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:22:31.978263 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:22:31.979161 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:22:31.979161 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 01:22:31.979161 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 01:22:31.979161 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 01:22:31.979161 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 01:22:31.979161 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 01:22:31.979161 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 01:22:31.979161 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 01:22:31.979161 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 01:22:31.979161 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 01:22:31.979161 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 01:22:31.979161 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 01:22:31.979161 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 01:22:31.979161 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 01:22:31.979161 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 01:22:31.979161 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 01:22:31.979161 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 01:22:31.979161 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 01:22:31.979161 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 01:22:31.980054 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 01:22:31.980054 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 01:22:31.980054 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 01:22:31.980054 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 01:22:31.980054 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 08990705-281e-40b7-b810-464a1600bdd8 could not be found. Aug 31 01:22:31.980054 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:22:31.980054 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:22:31.980054 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:22:31.980054 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:22:31.980054 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:22:31.980054 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:22:31.980054 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:22:31.980054 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:22:31.980054 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 01:22:31.980054 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 01:22:31.980054 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:22:31.980054 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:22:31.980054 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 01:22:31.980054 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:22:31.981056 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 08990705-281e-40b7-b810-464a1600bdd8 could not be found. Aug 31 01:22:31.981056 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:22:31.981056 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:22:31.981056 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:22:31.981056 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:22:31.981056 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:22:31.981056 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:22:31.981056 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:22:31.981056 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:22:31.981056 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 08990705-281e-40b7-b810-464a1600bdd8 could not be found. Aug 31 01:22:31.981056 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:22:31.981056 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-c9205be8-79c3-4447-b840-5f2d2fb620d1 tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] Returning 404 to user: Volume 08990705-281e-40b7-b810-464a1600bdd8 could not be found. {{(pid=121025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:22:31.981056 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-c9205be8-79c3-4447-b840-5f2d2fb620d1 tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/08990705-281e-40b7-b810-464a1600bdd8" status: 404 len: 109 microversion: 2.1 time: 0.096567 Aug 31 01:22:31.981056 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 9/28] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Aug 31 01:22:31 2022] DELETE /compute/v2.1/os-volumes/08990705-281e-40b7-b810-464a1600bdd8 => generated 109 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:22:31.987747 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-ab2f50ef-6b96-482a-a10d-a47565ea8959 tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] Calling method '.version_select at 0x7f1fe1c185e0>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:32.034395 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.wsgi [None req-ab2f50ef-6b96-482a-a10d-a47565ea8959 tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] HTTP exception thrown: Volume 08990705-281e-40b7-b810-464a1600bdd8 could not be found. Aug 31 01:22:32.038595 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-ab2f50ef-6b96-482a-a10d-a47565ea8959 tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] Request method failure captured: Aug 31 01:22:32.038595 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: request: GET /compute/v2.1/os-volumes/08990705-281e-40b7-b810-464a1600bdd8 HTTP/1.1 Aug 31 01:22:32.038595 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept: application/json Aug 31 01:22:32.038595 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept-Encoding: identity Aug 31 01:22:32.038595 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Connection: close Aug 31 01:22:32.038595 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Length: 0 Aug 31 01:22:32.038595 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Type: application/json Aug 31 01:22:32.038595 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Host: 10.222.0.20 Aug 31 01:22:32.038595 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Openstack-System-Scope: None Aug 31 01:22:32.038595 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: User-Agent: python-urllib3/1.26.12 Aug 31 01:22:32.038595 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Auth-Token: gAAAAABjDrfLrrb4Ulw5B5SEPHHcM-x2O4TbdJxT7ApuVHMrlSAE8WqUo4kImwK8hwxFEJX0EuGkohZBAHx2ANENB2Vt7gaM-_573kW6XzHtgwatyzZqlv9YYeQlXTfQ3CUhRu3uNsWhGJbLKCZM8xL2BOndlxB5dnsj0IyNpX89itgopKZI_aw Aug 31 01:22:32.038595 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Id: None Aug 31 01:22:32.038595 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Name: None Aug 31 01:22:32.038595 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Identity-Status: Confirmed Aug 31 01:22:32.038595 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Is-Admin-Project: True Aug 31 01:22:32.038595 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Id: default Aug 31 01:22:32.038595 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Name: Default Aug 31 01:22:32.038595 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Id: 314a7f3b9a1c48e98ff114f51e82ff01 Aug 31 01:22:32.038595 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-342262264 Aug 31 01:22:32.038595 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Role: member,reader Aug 31 01:22:32.038595 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Roles: member,reader Aug 31 01:22:32.039837 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/314a7f3b9a1c48e98ff114f51e82ff01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_314a7f3b9a1c48e98ff114f51e82ff01", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/314a7f3b9a1c48e98ff114f51e82ff01"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/314a7f3b9a1c48e98ff114f51e82ff01"}]}] Aug 31 01:22:32.039837 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant: tempest-VolumesSnapshotsTestJSON-342262264 Aug 31 01:22:32.039837 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Id: 314a7f3b9a1c48e98ff114f51e82ff01 Aug 31 01:22:32.039837 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-342262264 Aug 31 01:22:32.039837 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User: tempest-VolumesSnapshotsTestJSON-342262264-project Aug 31 01:22:32.039837 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Id: default Aug 31 01:22:32.039837 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Name: Default Aug 31 01:22:32.039837 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Id: 8b73724e8e94402d8d18777f57a257e3 Aug 31 01:22:32.039837 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Name: tempest-VolumesSnapshotsTestJSON-342262264-project Aug 31 01:22:32.039837 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: method: Aug 31 01:22:32.039837 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: exception: Volume 08990705-281e-40b7-b810-464a1600bdd8 could not be found. Aug 31 01:22:32.039837 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: action_args: {'id': '08990705-281e-40b7-b810-464a1600bdd8'} Aug 31 01:22:32.039837 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:22:32.040672 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:22:32.040672 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 01:22:32.040672 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 01:22:32.040672 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 01:22:32.040672 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 01:22:32.040672 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 01:22:32.040672 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 01:22:32.040672 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 01:22:32.040672 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 01:22:32.040672 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 01:22:32.040672 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 01:22:32.040672 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 01:22:32.040672 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 01:22:32.040672 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 01:22:32.040672 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 01:22:32.040672 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 08990705-281e-40b7-b810-464a1600bdd8 could not be found. (HTTP 404) (Request-ID: req-d331f573-cd4f-4de4-8674-cc8ce31e4957) Aug 31 01:22:32.040672 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:22:32.040672 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:22:32.040672 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:22:32.041694 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:22:32.041694 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 01:22:32.041694 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 01:22:32.041694 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 01:22:32.041694 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 01:22:32.041694 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 01:22:32.041694 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 01:22:32.041694 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 01:22:32.041694 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 01:22:32.041694 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 01:22:32.041694 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 01:22:32.041694 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 01:22:32.041694 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 01:22:32.041694 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 01:22:32.041694 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 01:22:32.041694 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 01:22:32.041694 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 01:22:32.041694 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 01:22:32.041694 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 01:22:32.042553 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 01:22:32.042553 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 01:22:32.042553 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 01:22:32.042553 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 01:22:32.042553 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 08990705-281e-40b7-b810-464a1600bdd8 could not be found. Aug 31 01:22:32.042553 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:22:32.042553 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:22:32.042553 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:22:32.042553 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:22:32.042553 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:22:32.042553 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:22:32.042553 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:22:32.042553 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:22:32.042553 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 01:22:32.042553 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 01:22:32.042553 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:22:32.042553 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:22:32.042553 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 01:22:32.042553 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:22:32.043509 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 08990705-281e-40b7-b810-464a1600bdd8 could not be found. Aug 31 01:22:32.043509 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:22:32.043509 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:22:32.043509 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:22:32.043509 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:22:32.043509 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:22:32.043509 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:22:32.043509 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:22:32.043509 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:22:32.043509 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 08990705-281e-40b7-b810-464a1600bdd8 could not be found. Aug 31 01:22:32.043509 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:22:32.043509 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-ab2f50ef-6b96-482a-a10d-a47565ea8959 tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] Returning 404 to user: Volume 08990705-281e-40b7-b810-464a1600bdd8 could not be found. {{(pid=121025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:22:32.043509 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-ab2f50ef-6b96-482a-a10d-a47565ea8959 tempest-VolumesSnapshotsTestJSON-342262264 tempest-VolumesSnapshotsTestJSON-342262264-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/08990705-281e-40b7-b810-464a1600bdd8" status: 404 len: 109 microversion: 2.1 time: 0.058157 Aug 31 01:22:32.043509 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 10/29] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 31 01:22:31 2022] GET /compute/v2.1/os-volumes/08990705-281e-40b7-b810-464a1600bdd8 => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:22:32.165303 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-fb02993c-3968-4aab-a97a-c1ede1612659 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d058c2b40343a6a3e2e46f6b2bab0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb95e8d0a84b76a5d141815451ceae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:22:32.213284 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-fb02993c-3968-4aab-a97a-c1ede1612659 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] 10.222.0.20 "GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5" status: 200 len: 1213 microversion: 2.1 time: 0.491292 Aug 31 01:22:32.221333 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 20/30] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:22:31 2022] GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5 => generated 1213 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:22:33.236384 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-43d8c798-7df5-4e47-80a5-1dfaaa92fb50 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:33.240146 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-43d8c798-7df5-4e47-80a5-1dfaaa92fb50 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] [instance: 3f2e4287-f02a-4d2f-a669-621ae355fce5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:22:33.416541 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-43d8c798-7df5-4e47-80a5-1dfaaa92fb50 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d058c2b40343a6a3e2e46f6b2bab0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb95e8d0a84b76a5d141815451ceae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:22:33.462231 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-43d8c798-7df5-4e47-80a5-1dfaaa92fb50 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] 10.222.0.20 "GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5" status: 200 len: 1213 microversion: 2.1 time: 0.229992 Aug 31 01:22:33.464906 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 11/31] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:22:33 2022] GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5 => generated 1213 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:22:34.486241 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-106562b8-cc16-45db-958a-d3cee6a4db8c tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:34.487063 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-106562b8-cc16-45db-958a-d3cee6a4db8c tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] [instance: 3f2e4287-f02a-4d2f-a669-621ae355fce5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:22:35.135811 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-106562b8-cc16-45db-958a-d3cee6a4db8c tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d058c2b40343a6a3e2e46f6b2bab0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb95e8d0a84b76a5d141815451ceae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:22:35.150407 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-106562b8-cc16-45db-958a-d3cee6a4db8c tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] 10.222.0.20 "GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5" status: 200 len: 1213 microversion: 2.1 time: 0.664276 Aug 31 01:22:35.153440 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 21/32] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:22:34 2022] GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5 => generated 1213 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:22:36.174545 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-8b4b3838-d9d8-4e62-9deb-29bd80423358 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:36.175718 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-8b4b3838-d9d8-4e62-9deb-29bd80423358 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] [instance: 3f2e4287-f02a-4d2f-a669-621ae355fce5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:22:36.211907 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8b4b3838-d9d8-4e62-9deb-29bd80423358 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:36.214157 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8b4b3838-d9d8-4e62-9deb-29bd80423358 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:36.214864 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8b4b3838-d9d8-4e62-9deb-29bd80423358 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:36.220418 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8b4b3838-d9d8-4e62-9deb-29bd80423358 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:36.231898 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8b4b3838-d9d8-4e62-9deb-29bd80423358 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:36.234410 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8b4b3838-d9d8-4e62-9deb-29bd80423358 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:36.694834 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-8b4b3838-d9d8-4e62-9deb-29bd80423358 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d058c2b40343a6a3e2e46f6b2bab0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb95e8d0a84b76a5d141815451ceae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:22:36.729164 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-8b4b3838-d9d8-4e62-9deb-29bd80423358 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] 10.222.0.20 "GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5" status: 200 len: 1265 microversion: 2.1 time: 0.554267 Aug 31 01:22:36.730288 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 12/33] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:22:36 2022] GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5 => generated 1265 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:22:37.755349 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-82e18160-a47f-4cff-a3ba-0eacc35246ba tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:37.760128 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-82e18160-a47f-4cff-a3ba-0eacc35246ba tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] [instance: 3f2e4287-f02a-4d2f-a669-621ae355fce5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:22:37.774538 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-82e18160-a47f-4cff-a3ba-0eacc35246ba tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:37.775043 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-82e18160-a47f-4cff-a3ba-0eacc35246ba tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:37.775483 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-82e18160-a47f-4cff-a3ba-0eacc35246ba tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:37.776191 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-82e18160-a47f-4cff-a3ba-0eacc35246ba tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:37.776645 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-82e18160-a47f-4cff-a3ba-0eacc35246ba tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:37.777100 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-82e18160-a47f-4cff-a3ba-0eacc35246ba tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:37.981975 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-82e18160-a47f-4cff-a3ba-0eacc35246ba tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d058c2b40343a6a3e2e46f6b2bab0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb95e8d0a84b76a5d141815451ceae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:22:37.994751 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-82e18160-a47f-4cff-a3ba-0eacc35246ba tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] 10.222.0.20 "GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5" status: 200 len: 1271 microversion: 2.1 time: 0.244217 Aug 31 01:22:38.014381 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 13/34] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:22:37 2022] GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5 => generated 1271 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:22:38.340426 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-4c79a931-13d6-463a-9168-a50390cbf15c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-150986759", "imageRef": "ed6d3236-defa-4ccf-90ba-343c0d0ad58e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:22:38.564464 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.network.neutron [None req-4c79a931-13d6-463a-9168-a50390cbf15c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] validate_networks() for [('0303b68a-9736-48eb-90f1-d3c52026d074', None, None, None, None, None)] {{(pid=121026) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 01:22:38.952097 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-c40c5f4f-00f2-4351-b350-70f3ee008330 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Action: 'create', calling method: .version_select at 0x7f1fe1b33ca0>, body: {"keypair": {"name": "tempest-keypair-60556780", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfJggHhoAuhPcCMHY3qnnDV3HHd/hWEvbR7Ap9FK4sjq8/KXK/+Yj4KA/A/qfpSIghHZ12zjGyduBuQJemttWQf5oW9EkLr9tfsnuzx8kdKLWsEP7thU+UYeEqFYRuxrA=="}} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:22:39.033482 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.quota [None req-c40c5f4f-00f2-4351-b350-70f3ee008330 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Getting quotas for project 164da7d4776d4e9f8cf6497aa784d312. Resources: {'key_pairs'} {{(pid=121025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 01:22:39.054821 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.quota [None req-c40c5f4f-00f2-4351-b350-70f3ee008330 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Getting quotas for user 52ed99737fd240789bb682fd9bf11be3 and project 164da7d4776d4e9f8cf6497aa784d312. Resources: {'key_pairs'} {{(pid=121025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 01:22:39.197953 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-c40c5f4f-00f2-4351-b350-70f3ee008330 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.892927 Aug 31 01:22:39.206112 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 14/35] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Aug 31 01:22:38 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:22:39.221365 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-12b3a358-4c1e-4773-910d-ed2c038246f6 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:39.223458 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-12b3a358-4c1e-4773-910d-ed2c038246f6 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] [instance: 3f2e4287-f02a-4d2f-a669-621ae355fce5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:22:39.244302 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-12b3a358-4c1e-4773-910d-ed2c038246f6 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:39.246800 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-12b3a358-4c1e-4773-910d-ed2c038246f6 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:39.247414 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-12b3a358-4c1e-4773-910d-ed2c038246f6 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:39.248294 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-12b3a358-4c1e-4773-910d-ed2c038246f6 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:39.250406 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-12b3a358-4c1e-4773-910d-ed2c038246f6 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:39.251294 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-12b3a358-4c1e-4773-910d-ed2c038246f6 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:40.180031 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-12b3a358-4c1e-4773-910d-ed2c038246f6 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d058c2b40343a6a3e2e46f6b2bab0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb95e8d0a84b76a5d141815451ceae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:22:40.236063 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-12b3a358-4c1e-4773-910d-ed2c038246f6 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] 10.222.0.20 "GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5" status: 200 len: 1313 microversion: 2.1 time: 1.027547 Aug 31 01:22:40.240153 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 15/36] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:22:39 2022] GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5 => generated 1313 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:22:41.012963 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-596a3d9e-2836-45f5-854a-f96dfe0a6f54 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Action: 'create', calling method: .version_select at 0x7f1fe1ae4790>, body: {"keypair": {"name": "tempest-keypair-2069606184", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBn0Jd4TI6jvJPdanLpxROnBikGC5LJHxLHAEqxzBe77NrdRYX3uy/XoxHFZ78I+Npw3DCiTLAVV6g2u21jm1Z+3XEiFkGJPiT58QIn27XQr7kQ2UcjRllzZK0MZ0FCLJg=="}} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:22:41.050007 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.quota [None req-596a3d9e-2836-45f5-854a-f96dfe0a6f54 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Getting quotas for project 53d2295ada114ea3b6b5001c4c197f35. Resources: {'key_pairs'} {{(pid=121025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 01:22:41.069527 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.quota [None req-596a3d9e-2836-45f5-854a-f96dfe0a6f54 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Getting quotas for user efaf57b6482149ca86a9bba26d7654f2 and project 53d2295ada114ea3b6b5001c4c197f35. Resources: {'key_pairs'} {{(pid=121025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 01:22:41.208738 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell0:SELECT=2 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:22:41.215226 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-596a3d9e-2836-45f5-854a-f96dfe0a6f54 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.973630 Aug 31 01:22:41.218708 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 16/37] 10.222.0.20 () {62 vars in 1200 bytes} [Wed Aug 31 01:22:40 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 978 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 01:22:41.267324 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-4969961c-6e92-4db3-9168-ddb14eb82a4b tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:41.268405 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-4969961c-6e92-4db3-9168-ddb14eb82a4b tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] [instance: 3f2e4287-f02a-4d2f-a669-621ae355fce5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:22:41.281627 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4969961c-6e92-4db3-9168-ddb14eb82a4b tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:41.282199 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4969961c-6e92-4db3-9168-ddb14eb82a4b tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:41.282647 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4969961c-6e92-4db3-9168-ddb14eb82a4b tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:41.283766 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4969961c-6e92-4db3-9168-ddb14eb82a4b tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:41.284532 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4969961c-6e92-4db3-9168-ddb14eb82a4b tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:41.285044 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4969961c-6e92-4db3-9168-ddb14eb82a4b tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:41.334761 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.virt.hardware [None req-4c79a931-13d6-463a-9168-a50390cbf15c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Flavor limits 0:0:0 {{(pid=121026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 01:22:41.336008 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.virt.hardware [None req-4c79a931-13d6-463a-9168-a50390cbf15c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Image limits 0:0:0 {{(pid=121026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 01:22:41.336656 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.virt.hardware [None req-4c79a931-13d6-463a-9168-a50390cbf15c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Flavor pref 0:0:0 {{(pid=121026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 01:22:41.337427 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.virt.hardware [None req-4c79a931-13d6-463a-9168-a50390cbf15c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Image pref 0:0:0 {{(pid=121026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 01:22:41.338069 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.virt.hardware [None req-4c79a931-13d6-463a-9168-a50390cbf15c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 01:22:41.370318 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4c79a931-13d6-463a-9168-a50390cbf15c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:41.373541 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4c79a931-13d6-463a-9168-a50390cbf15c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:41.374842 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4c79a931-13d6-463a-9168-a50390cbf15c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:41.376131 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4c79a931-13d6-463a-9168-a50390cbf15c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:41.381799 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4c79a931-13d6-463a-9168-a50390cbf15c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:41.383479 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4c79a931-13d6-463a-9168-a50390cbf15c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:41.498257 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.quota [None req-4c79a931-13d6-463a-9168-a50390cbf15c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Getting quotas for project d58414b1dd2342d58cc7665aee50b86b. Resources: {'instances', 'cores', 'ram'} {{(pid=121026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 01:22:41.521010 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.quota [None req-4c79a931-13d6-463a-9168-a50390cbf15c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Getting quotas for user 71d0408df86f4be0ac59cc80575a14e2 and project d58414b1dd2342d58cc7665aee50b86b. Resources: {'instances', 'cores', 'ram'} {{(pid=121026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 01:22:41.535805 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-4c79a931-13d6-463a-9168-a50390cbf15c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Going to run 1 instances... {{(pid=121026) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 01:22:41.539446 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-4c79a931-13d6-463a-9168-a50390cbf15c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: ee6ca45e-29c7-4af8-8aef-72134f23292c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ed6d3236-defa-4ccf-90ba-343c0d0ad58e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121026) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 01:22:41.996940 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-4c79a931-13d6-463a-9168-a50390cbf15c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.539178 Aug 31 01:22:42.007232 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 22/38] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 31 01:22:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 4551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 01:22:42.028176 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-59569638-f613-473a-8b41-821f3130e031 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:42.032566 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-59569638-f613-473a-8b41-821f3130e031 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: ee6ca45e-29c7-4af8-8aef-72134f23292c] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:22:42.058841 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-4969961c-6e92-4db3-9168-ddb14eb82a4b tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d058c2b40343a6a3e2e46f6b2bab0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb95e8d0a84b76a5d141815451ceae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:22:42.072676 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-4969961c-6e92-4db3-9168-ddb14eb82a4b tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] 10.222.0.20 "GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5" status: 200 len: 1313 microversion: 2.1 time: 0.813482 Aug 31 01:22:42.087754 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 17/39] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:22:41 2022] GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5 => generated 1313 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:22:43.095662 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-fec8dcd0-9a97-4553-893d-9cd414b1b84e tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:43.097088 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-fec8dcd0-9a97-4553-893d-9cd414b1b84e tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] [instance: 3f2e4287-f02a-4d2f-a669-621ae355fce5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:22:43.107512 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fec8dcd0-9a97-4553-893d-9cd414b1b84e tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:43.109320 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fec8dcd0-9a97-4553-893d-9cd414b1b84e tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:43.110175 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fec8dcd0-9a97-4553-893d-9cd414b1b84e tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:43.111796 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fec8dcd0-9a97-4553-893d-9cd414b1b84e tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:43.113067 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fec8dcd0-9a97-4553-893d-9cd414b1b84e tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:43.115648 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fec8dcd0-9a97-4553-893d-9cd414b1b84e tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:43.154629 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-59569638-f613-473a-8b41-821f3130e031 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:22:43.164212 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-59569638-f613-473a-8b41-821f3130e031 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c" status: 200 len: 1221 microversion: 2.1 time: 1.150001 Aug 31 01:22:43.172703 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 23/40] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:22:42 2022] GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c => generated 1221 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:22:43.701109 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-0b6f6f58-8732-4fb7-9a0f-99a8b5328d2f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-152634169", "imageRef": "ed6d3236-defa-4ccf-90ba-343c0d0ad58e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:22:43.900408 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.network.neutron [None req-0b6f6f58-8732-4fb7-9a0f-99a8b5328d2f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] validate_networks() for [('0303b68a-9736-48eb-90f1-d3c52026d074', None, None, None, None, None)] {{(pid=121026) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 01:22:44.441074 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-fec8dcd0-9a97-4553-893d-9cd414b1b84e tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d058c2b40343a6a3e2e46f6b2bab0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb95e8d0a84b76a5d141815451ceae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:22:44.451046 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-fec8dcd0-9a97-4553-893d-9cd414b1b84e tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] 10.222.0.20 "GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5" status: 200 len: 1313 microversion: 2.1 time: 1.360315 Aug 31 01:22:44.478381 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 18/41] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:22:43 2022] GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5 => generated 1313 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:22:45.483901 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-4685ac20-97da-4b95-a6a6-81d7c1a08af7 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:45.484592 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-4685ac20-97da-4b95-a6a6-81d7c1a08af7 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] [instance: 3f2e4287-f02a-4d2f-a669-621ae355fce5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:22:45.500317 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4685ac20-97da-4b95-a6a6-81d7c1a08af7 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:45.501280 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4685ac20-97da-4b95-a6a6-81d7c1a08af7 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:45.502045 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4685ac20-97da-4b95-a6a6-81d7c1a08af7 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:45.503372 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4685ac20-97da-4b95-a6a6-81d7c1a08af7 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:45.504097 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4685ac20-97da-4b95-a6a6-81d7c1a08af7 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:45.504932 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4685ac20-97da-4b95-a6a6-81d7c1a08af7 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:47.067464 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.virt.hardware [None req-0b6f6f58-8732-4fb7-9a0f-99a8b5328d2f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Flavor limits 0:0:0 {{(pid=121026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 01:22:47.068247 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.virt.hardware [None req-0b6f6f58-8732-4fb7-9a0f-99a8b5328d2f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Image limits 0:0:0 {{(pid=121026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 01:22:47.068752 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.virt.hardware [None req-0b6f6f58-8732-4fb7-9a0f-99a8b5328d2f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Flavor pref 0:0:0 {{(pid=121026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 01:22:47.069363 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.virt.hardware [None req-0b6f6f58-8732-4fb7-9a0f-99a8b5328d2f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Image pref 0:0:0 {{(pid=121026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 01:22:47.070072 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.virt.hardware [None req-0b6f6f58-8732-4fb7-9a0f-99a8b5328d2f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 01:22:47.091658 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0b6f6f58-8732-4fb7-9a0f-99a8b5328d2f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:47.093968 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0b6f6f58-8732-4fb7-9a0f-99a8b5328d2f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:47.106074 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0b6f6f58-8732-4fb7-9a0f-99a8b5328d2f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:47.107185 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0b6f6f58-8732-4fb7-9a0f-99a8b5328d2f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:47.111955 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0b6f6f58-8732-4fb7-9a0f-99a8b5328d2f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:47.115057 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0b6f6f58-8732-4fb7-9a0f-99a8b5328d2f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:47.167260 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.quota [None req-0b6f6f58-8732-4fb7-9a0f-99a8b5328d2f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Getting quotas for project d58414b1dd2342d58cc7665aee50b86b. Resources: {'instances', 'cores', 'ram'} {{(pid=121026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 01:22:47.181630 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.quota [None req-0b6f6f58-8732-4fb7-9a0f-99a8b5328d2f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Getting quotas for user 71d0408df86f4be0ac59cc80575a14e2 and project d58414b1dd2342d58cc7665aee50b86b. Resources: {'instances', 'cores', 'ram'} {{(pid=121026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 01:22:47.229408 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-0b6f6f58-8732-4fb7-9a0f-99a8b5328d2f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Going to run 1 instances... {{(pid=121026) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 01:22:47.234516 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-0b6f6f58-8732-4fb7-9a0f-99a8b5328d2f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ed6d3236-defa-4ccf-90ba-343c0d0ad58e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121026) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 01:22:47.456561 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-0b6f6f58-8732-4fb7-9a0f-99a8b5328d2f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.771473 Aug 31 01:22:47.460373 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 24/42] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 31 01:22:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 3774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 01:22:47.780253 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-4685ac20-97da-4b95-a6a6-81d7c1a08af7 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d058c2b40343a6a3e2e46f6b2bab0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb95e8d0a84b76a5d141815451ceae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:22:47.791921 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-4685ac20-97da-4b95-a6a6-81d7c1a08af7 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] 10.222.0.20 "GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5" status: 200 len: 1313 microversion: 2.1 time: 2.312278 Aug 31 01:22:47.798654 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 19/43] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:22:45 2022] GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5 => generated 1313 bytes in 2319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:22:47.806959 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-0742374e-3eae-429c-b313-343b68cff694 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:47.813132 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-0742374e-3eae-429c-b313-343b68cff694 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:22:47.852281 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [req-18113d1f-30a7-4244-a790-8592fbaed711 req-87dedd86-58ee-404c-b951-ba3ba6cd7385 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f2e4287-f02a-4d2f-a669-621ae355fce5", "tag": "c7dd3835-d8c2-4dee-8cb0-6f3061af7f54"}]} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:22:47.901512 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-18113d1f-30a7-4244-a790-8592fbaed711 req-87dedd86-58ee-404c-b951-ba3ba6cd7385 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:47.905139 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-18113d1f-30a7-4244-a790-8592fbaed711 req-87dedd86-58ee-404c-b951-ba3ba6cd7385 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:47.905139 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-18113d1f-30a7-4244-a790-8592fbaed711 req-87dedd86-58ee-404c-b951-ba3ba6cd7385 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:48.096465 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.compute.server_external_events [req-18113d1f-30a7-4244-a790-8592fbaed711 req-87dedd86-58ee-404c-b951-ba3ba6cd7385 service nova] Creating event network-changed:c7dd3835-d8c2-4dee-8cb0-6f3061af7f54 for instance 3f2e4287-f02a-4d2f-a669-621ae355fce5 on hv-cinder-85528 Aug 31 01:22:48.099771 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-18113d1f-30a7-4244-a790-8592fbaed711 req-87dedd86-58ee-404c-b951-ba3ba6cd7385 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121026) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 01:22:48.099771 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-18113d1f-30a7-4244-a790-8592fbaed711 req-87dedd86-58ee-404c-b951-ba3ba6cd7385 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121026) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 01:22:48.107176 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f6f3c209-d71e-4a55-b510-6ff4f8fa6a35 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:48.111220 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f6f3c209-d71e-4a55-b510-6ff4f8fa6a35 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:48.117991 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f6f3c209-d71e-4a55-b510-6ff4f8fa6a35 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:48.122123 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f6f3c209-d71e-4a55-b510-6ff4f8fa6a35 None None] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:48.122827 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f6f3c209-d71e-4a55-b510-6ff4f8fa6a35 None None] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:48.124632 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f6f3c209-d71e-4a55-b510-6ff4f8fa6a35 None None] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:48.186365 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.compute.rpcapi [None req-f6f3c209-d71e-4a55-b510-6ff4f8fa6a35 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 01:22:48.187494 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f6f3c209-d71e-4a55-b510-6ff4f8fa6a35 None None] Releasing lock "compute-rpcapi-router" {{(pid=121026) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 01:22:48.244101 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-f6f3c209-d71e-4a55-b510-6ff4f8fa6a35 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.782995 Aug 31 01:22:48.247329 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 25/44] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:22:48.496879 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-0742374e-3eae-429c-b313-343b68cff694 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:22:48.527545 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-0742374e-3eae-429c-b313-343b68cff694 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 200 len: 1221 microversion: 2.1 time: 0.724299 Aug 31 01:22:48.531235 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 20/45] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:22:47 2022] GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 1221 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:22:48.825988 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-c25a2f71-35a1-4697-802f-05d63c0289a5 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:48.827076 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-c25a2f71-35a1-4697-802f-05d63c0289a5 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] [instance: 3f2e4287-f02a-4d2f-a669-621ae355fce5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:22:48.847869 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c25a2f71-35a1-4697-802f-05d63c0289a5 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:48.848368 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c25a2f71-35a1-4697-802f-05d63c0289a5 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:48.850140 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c25a2f71-35a1-4697-802f-05d63c0289a5 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:48.850916 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c25a2f71-35a1-4697-802f-05d63c0289a5 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:48.851378 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c25a2f71-35a1-4697-802f-05d63c0289a5 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:48.851808 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c25a2f71-35a1-4697-802f-05d63c0289a5 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:49.550465 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-3801e82a-8264-4ddf-80c4-45ac0f7ac203 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:49.551149 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-3801e82a-8264-4ddf-80c4-45ac0f7ac203 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:22:49.555388 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=5 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:22:49.562966 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3801e82a-8264-4ddf-80c4-45ac0f7ac203 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:49.563461 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3801e82a-8264-4ddf-80c4-45ac0f7ac203 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:49.566622 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3801e82a-8264-4ddf-80c4-45ac0f7ac203 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:49.568432 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3801e82a-8264-4ddf-80c4-45ac0f7ac203 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:49.572110 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3801e82a-8264-4ddf-80c4-45ac0f7ac203 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:49.574769 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3801e82a-8264-4ddf-80c4-45ac0f7ac203 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:50.131174 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-3801e82a-8264-4ddf-80c4-45ac0f7ac203 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:22:50.142968 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-c25a2f71-35a1-4697-802f-05d63c0289a5 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d058c2b40343a6a3e2e46f6b2bab0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb95e8d0a84b76a5d141815451ceae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:22:50.146575 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-3801e82a-8264-4ddf-80c4-45ac0f7ac203 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 200 len: 1225 microversion: 2.1 time: 0.600040 Aug 31 01:22:50.148118 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 21/46] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:22:49 2022] GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 1225 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:22:50.167356 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-c25a2f71-35a1-4697-802f-05d63c0289a5 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] 10.222.0.20 "GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5" status: 200 len: 1313 microversion: 2.1 time: 1.348925 Aug 31 01:22:50.171442 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 26/47] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:22:48 2022] GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5 => generated 1313 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:22:50.789201 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-71ac52e2-1b17-482b-8de8-db9d34d6bb3b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1949360391", "imageRef": "ed6d3236-defa-4ccf-90ba-343c0d0ad58e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0760f9a5-d813-4a0f-bcef-9988cda0c948"}], "security_groups": [{"name": "tempest-securitygroup--78043535"}], "key_name": "tempest-keypair-60556780", "user_data": "}} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:22:51.019589 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.network.neutron [None req-71ac52e2-1b17-482b-8de8-db9d34d6bb3b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] validate_networks() for [('0760f9a5-d813-4a0f-bcef-9988cda0c948', None, None, None, None, None)] {{(pid=121025) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 01:22:51.170024 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-e6f54592-0bd3-4785-a5fa-9a5ac97fbcd0 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:51.173794 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-e6f54592-0bd3-4785-a5fa-9a5ac97fbcd0 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:22:51.206800 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e6f54592-0bd3-4785-a5fa-9a5ac97fbcd0 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:51.207706 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e6f54592-0bd3-4785-a5fa-9a5ac97fbcd0 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:51.209247 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e6f54592-0bd3-4785-a5fa-9a5ac97fbcd0 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:51.211575 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e6f54592-0bd3-4785-a5fa-9a5ac97fbcd0 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:51.214813 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e6f54592-0bd3-4785-a5fa-9a5ac97fbcd0 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:51.215520 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e6f54592-0bd3-4785-a5fa-9a5ac97fbcd0 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:51.646223 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-e6f54592-0bd3-4785-a5fa-9a5ac97fbcd0 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:22:51.662063 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-e6f54592-0bd3-4785-a5fa-9a5ac97fbcd0 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 200 len: 1273 microversion: 2.1 time: 0.496931 Aug 31 01:22:51.667002 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 27/48] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:22:51 2022] GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 1273 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:22:51.683758 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-9d504b37-e4cb-4a12-baa8-221938db1b8b tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:51.684802 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-9d504b37-e4cb-4a12-baa8-221938db1b8b tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] [instance: 3f2e4287-f02a-4d2f-a669-621ae355fce5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:22:51.695206 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9d504b37-e4cb-4a12-baa8-221938db1b8b tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:51.697549 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9d504b37-e4cb-4a12-baa8-221938db1b8b tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:51.699567 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9d504b37-e4cb-4a12-baa8-221938db1b8b tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:51.706890 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9d504b37-e4cb-4a12-baa8-221938db1b8b tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:51.707876 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9d504b37-e4cb-4a12-baa8-221938db1b8b tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:51.709890 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9d504b37-e4cb-4a12-baa8-221938db1b8b tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:52.804773 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-9d504b37-e4cb-4a12-baa8-221938db1b8b tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d058c2b40343a6a3e2e46f6b2bab0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb95e8d0a84b76a5d141815451ceae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:22:52.815293 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-9d504b37-e4cb-4a12-baa8-221938db1b8b tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] 10.222.0.20 "GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5" status: 200 len: 1313 microversion: 2.1 time: 1.145679 Aug 31 01:22:52.815893 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 28/49] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:22:51 2022] GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5 => generated 1313 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:22:52.841226 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-b750e6fd-5138-40ee-9af2-cfa56d880b4c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:52.845590 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-b750e6fd-5138-40ee-9af2-cfa56d880b4c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:22:52.849247 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=6 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:22:52.867740 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b750e6fd-5138-40ee-9af2-cfa56d880b4c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:52.868247 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b750e6fd-5138-40ee-9af2-cfa56d880b4c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:52.868906 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b750e6fd-5138-40ee-9af2-cfa56d880b4c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:52.875972 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b750e6fd-5138-40ee-9af2-cfa56d880b4c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:52.875972 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b750e6fd-5138-40ee-9af2-cfa56d880b4c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:52.875972 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b750e6fd-5138-40ee-9af2-cfa56d880b4c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:53.659750 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-b750e6fd-5138-40ee-9af2-cfa56d880b4c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:22:53.669133 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-b750e6fd-5138-40ee-9af2-cfa56d880b4c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 200 len: 1279 microversion: 2.1 time: 0.834623 Aug 31 01:22:53.670488 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 29/50] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:22:52 2022] GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 1279 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:22:53.679427 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-76a95048-628f-44ba-aaae-cbab2bcde18e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1604617908", "imageRef": "ed6d3236-defa-4ccf-90ba-343c0d0ad58e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2a0890c6-f1c3-465a-8b4d-8e1ae2356a58"}], "security_groups": [{"name": "tempest-securitygroup--1762624992"}], "key_name": "tempest-keypair-2069606184", "user_data": "}} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:22:54.095408 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.network.neutron [None req-76a95048-628f-44ba-aaae-cbab2bcde18e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] validate_networks() for [('2a0890c6-f1c3-465a-8b4d-8e1ae2356a58', None, None, None, None, None)] {{(pid=121026) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 01:22:54.123534 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-71ac52e2-1b17-482b-8de8-db9d34d6bb3b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Flavor limits 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 01:22:54.125230 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-71ac52e2-1b17-482b-8de8-db9d34d6bb3b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Image limits 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 01:22:54.126313 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-71ac52e2-1b17-482b-8de8-db9d34d6bb3b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Flavor pref 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 01:22:54.127279 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-71ac52e2-1b17-482b-8de8-db9d34d6bb3b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Image pref 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 01:22:54.128275 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-71ac52e2-1b17-482b-8de8-db9d34d6bb3b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 01:22:54.160215 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-71ac52e2-1b17-482b-8de8-db9d34d6bb3b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:54.163248 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-71ac52e2-1b17-482b-8de8-db9d34d6bb3b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:54.165970 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-71ac52e2-1b17-482b-8de8-db9d34d6bb3b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:54.167310 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-71ac52e2-1b17-482b-8de8-db9d34d6bb3b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:54.173927 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-71ac52e2-1b17-482b-8de8-db9d34d6bb3b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:54.173927 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-71ac52e2-1b17-482b-8de8-db9d34d6bb3b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:54.225865 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.quota [None req-71ac52e2-1b17-482b-8de8-db9d34d6bb3b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Getting quotas for project 164da7d4776d4e9f8cf6497aa784d312. Resources: {'instances', 'cores', 'ram'} {{(pid=121025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 01:22:54.266782 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.quota [None req-71ac52e2-1b17-482b-8de8-db9d34d6bb3b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Getting quotas for user 52ed99737fd240789bb682fd9bf11be3 and project 164da7d4776d4e9f8cf6497aa784d312. Resources: {'instances', 'cores', 'ram'} {{(pid=121025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 01:22:54.303341 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-71ac52e2-1b17-482b-8de8-db9d34d6bb3b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Going to run 1 instances... {{(pid=121025) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 01:22:54.306627 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-71ac52e2-1b17-482b-8de8-db9d34d6bb3b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 8ce564c8-7a17-4de1-96b9-3737fca73840] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ed6d3236-defa-4ccf-90ba-343c0d0ad58e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 01:22:54.539832 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-71ac52e2-1b17-482b-8de8-db9d34d6bb3b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 3.755362 Aug 31 01:22:54.542672 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 22/51] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 31 01:22:50 2022] POST /compute/v2.1/servers => generated 400 bytes in 3759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 01:22:54.562860 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-48c1dfa7-9a36-44b5-873f-411ed0e34ec4 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:54.563651 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-48c1dfa7-9a36-44b5-873f-411ed0e34ec4 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] [instance: 3f2e4287-f02a-4d2f-a669-621ae355fce5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:22:54.578364 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-48c1dfa7-9a36-44b5-873f-411ed0e34ec4 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:54.579454 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-48c1dfa7-9a36-44b5-873f-411ed0e34ec4 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:54.580129 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-48c1dfa7-9a36-44b5-873f-411ed0e34ec4 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:54.584238 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-48c1dfa7-9a36-44b5-873f-411ed0e34ec4 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:54.585072 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-48c1dfa7-9a36-44b5-873f-411ed0e34ec4 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:54.585685 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-48c1dfa7-9a36-44b5-873f-411ed0e34ec4 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:55.728945 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-48c1dfa7-9a36-44b5-873f-411ed0e34ec4 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d058c2b40343a6a3e2e46f6b2bab0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb95e8d0a84b76a5d141815451ceae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:22:55.748770 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-48c1dfa7-9a36-44b5-873f-411ed0e34ec4 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] 10.222.0.20 "GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5" status: 200 len: 1313 microversion: 2.1 time: 1.184380 Aug 31 01:22:55.748770 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 23/52] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:22:54 2022] GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5 => generated 1313 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:22:55.751283 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-500b375d-a896-49f0-a3f8-93b60b9b9ce9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:55.755191 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-500b375d-a896-49f0-a3f8-93b60b9b9ce9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 8ce564c8-7a17-4de1-96b9-3737fca73840] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:22:55.871916 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-500b375d-a896-49f0-a3f8-93b60b9b9ce9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:22:55.879100 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-500b375d-a896-49f0-a3f8-93b60b9b9ce9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840" status: 200 len: 1240 microversion: 2.1 time: 0.135508 Aug 31 01:22:55.880759 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 24/53] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:22:55 2022] GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840 => generated 1240 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:22:55.885560 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-7ca6fecf-2831-499a-a788-4620b253cb9f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:55.886343 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-7ca6fecf-2831-499a-a788-4620b253cb9f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:22:55.892711 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7ca6fecf-2831-499a-a788-4620b253cb9f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:55.893385 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7ca6fecf-2831-499a-a788-4620b253cb9f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:55.893981 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7ca6fecf-2831-499a-a788-4620b253cb9f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:55.894832 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7ca6fecf-2831-499a-a788-4620b253cb9f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:55.895455 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7ca6fecf-2831-499a-a788-4620b253cb9f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:55.896155 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7ca6fecf-2831-499a-a788-4620b253cb9f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:56.187114 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-7ca6fecf-2831-499a-a788-4620b253cb9f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:22:56.195360 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-7ca6fecf-2831-499a-a788-4620b253cb9f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 200 len: 1321 microversion: 2.1 time: 0.313446 Aug 31 01:22:56.196241 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 25/54] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:22:55 2022] GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 1321 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:22:56.216446 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.virt.hardware [None req-76a95048-628f-44ba-aaae-cbab2bcde18e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Flavor limits 0:0:0 {{(pid=121026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 01:22:56.224096 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.virt.hardware [None req-76a95048-628f-44ba-aaae-cbab2bcde18e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Image limits 0:0:0 {{(pid=121026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 01:22:56.224096 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.virt.hardware [None req-76a95048-628f-44ba-aaae-cbab2bcde18e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Flavor pref 0:0:0 {{(pid=121026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 01:22:56.224096 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.virt.hardware [None req-76a95048-628f-44ba-aaae-cbab2bcde18e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Image pref 0:0:0 {{(pid=121026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 01:22:56.224096 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.virt.hardware [None req-76a95048-628f-44ba-aaae-cbab2bcde18e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 01:22:56.226759 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell0:SELECT=19 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:22:56.231936 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-76a95048-628f-44ba-aaae-cbab2bcde18e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:56.232717 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-76a95048-628f-44ba-aaae-cbab2bcde18e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:56.233855 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-76a95048-628f-44ba-aaae-cbab2bcde18e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:56.234894 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-76a95048-628f-44ba-aaae-cbab2bcde18e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:56.236470 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-76a95048-628f-44ba-aaae-cbab2bcde18e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:56.238178 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-76a95048-628f-44ba-aaae-cbab2bcde18e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:56.260230 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-d90f7ceb-1b63-48dd-8506-41cb69d01a61 req-77c01507-d5e1-4f21-8004-fab988d4e652 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee6ca45e-29c7-4af8-8aef-72134f23292c", "tag": "388de9da-77e7-4d40-9542-da91eb9630e0"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:22:56.266949 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.quota [None req-76a95048-628f-44ba-aaae-cbab2bcde18e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Getting quotas for project 53d2295ada114ea3b6b5001c4c197f35. Resources: {'instances', 'cores', 'ram'} {{(pid=121026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 01:22:56.271995 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.quota [None req-76a95048-628f-44ba-aaae-cbab2bcde18e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Getting quotas for user efaf57b6482149ca86a9bba26d7654f2 and project 53d2295ada114ea3b6b5001c4c197f35. Resources: {'instances', 'cores', 'ram'} {{(pid=121026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 01:22:56.273619 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-d90f7ceb-1b63-48dd-8506-41cb69d01a61 req-77c01507-d5e1-4f21-8004-fab988d4e652 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:56.274310 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-d90f7ceb-1b63-48dd-8506-41cb69d01a61 req-77c01507-d5e1-4f21-8004-fab988d4e652 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:56.274971 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-d90f7ceb-1b63-48dd-8506-41cb69d01a61 req-77c01507-d5e1-4f21-8004-fab988d4e652 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:56.291597 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-76a95048-628f-44ba-aaae-cbab2bcde18e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Going to run 1 instances... {{(pid=121026) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 01:22:56.298569 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-d90f7ceb-1b63-48dd-8506-41cb69d01a61 req-77c01507-d5e1-4f21-8004-fab988d4e652 service nova] Creating event network-changed:388de9da-77e7-4d40-9542-da91eb9630e0 for instance ee6ca45e-29c7-4af8-8aef-72134f23292c on hv-cinder-85528 Aug 31 01:22:56.299432 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-d90f7ceb-1b63-48dd-8506-41cb69d01a61 req-77c01507-d5e1-4f21-8004-fab988d4e652 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121025) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 01:22:56.300011 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-d90f7ceb-1b63-48dd-8506-41cb69d01a61 req-77c01507-d5e1-4f21-8004-fab988d4e652 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121025) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 01:22:56.301308 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-664f1874-b8b6-4ced-b44d-175dc12b3252 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:56.302548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-664f1874-b8b6-4ced-b44d-175dc12b3252 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:56.302834 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-76a95048-628f-44ba-aaae-cbab2bcde18e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ed6d3236-defa-4ccf-90ba-343c0d0ad58e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121026) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 01:22:56.303454 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-664f1874-b8b6-4ced-b44d-175dc12b3252 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:56.304612 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-664f1874-b8b6-4ced-b44d-175dc12b3252 None None] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:56.305341 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-664f1874-b8b6-4ced-b44d-175dc12b3252 None None] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:56.306005 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-664f1874-b8b6-4ced-b44d-175dc12b3252 None None] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:56.316642 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.compute.rpcapi [None req-664f1874-b8b6-4ced-b44d-175dc12b3252 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 01:22:56.318487 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-664f1874-b8b6-4ced-b44d-175dc12b3252 None None] Releasing lock "compute-rpcapi-router" {{(pid=121025) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 01:22:56.340175 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-664f1874-b8b6-4ced-b44d-175dc12b3252 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142412 Aug 31 01:22:56.344344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 26/55] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:22:56.544128 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-76a95048-628f-44ba-aaae-cbab2bcde18e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.872055 Aug 31 01:22:56.552639 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 30/56] 10.222.0.20 () {62 vars in 1188 bytes} [Wed Aug 31 01:22:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 2881 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 01:22:56.570175 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-ce35529b-b457-409a-b8f4-869a7ac21535 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:56.573714 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-ce35529b-b457-409a-b8f4-869a7ac21535 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:22:56.705095 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-ce35529b-b457-409a-b8f4-869a7ac21535 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:22:56.714295 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-ce35529b-b457-409a-b8f4-869a7ac21535 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:22:56.715742 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-ce35529b-b457-409a-b8f4-869a7ac21535 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:22:56.717170 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-ce35529b-b457-409a-b8f4-869a7ac21535 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1282 microversion: 2.20 time: 0.162536 Aug 31 01:22:56.718033 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 27/57] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:22:56 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1282 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:22:56.763766 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-38fa966b-81b2-445d-9ccb-badda6793248 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:56.764709 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-38fa966b-81b2-445d-9ccb-badda6793248 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] [instance: 3f2e4287-f02a-4d2f-a669-621ae355fce5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:22:56.773616 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-38fa966b-81b2-445d-9ccb-badda6793248 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:56.774989 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-38fa966b-81b2-445d-9ccb-badda6793248 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:56.775590 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-38fa966b-81b2-445d-9ccb-badda6793248 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:56.776461 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-38fa966b-81b2-445d-9ccb-badda6793248 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:56.777476 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-38fa966b-81b2-445d-9ccb-badda6793248 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:56.778043 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-38fa966b-81b2-445d-9ccb-badda6793248 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:56.913051 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-89ba3b67-f327-4cfa-b273-75e7ea6ec543 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:56.913051 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-89ba3b67-f327-4cfa-b273-75e7ea6ec543 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 8ce564c8-7a17-4de1-96b9-3737fca73840] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:22:56.927142 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-89ba3b67-f327-4cfa-b273-75e7ea6ec543 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:56.927805 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-89ba3b67-f327-4cfa-b273-75e7ea6ec543 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:56.928391 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-89ba3b67-f327-4cfa-b273-75e7ea6ec543 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:56.929315 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-89ba3b67-f327-4cfa-b273-75e7ea6ec543 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:56.929911 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-89ba3b67-f327-4cfa-b273-75e7ea6ec543 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:56.931093 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-89ba3b67-f327-4cfa-b273-75e7ea6ec543 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:57.029685 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-89ba3b67-f327-4cfa-b273-75e7ea6ec543 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:22:57.038093 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-89ba3b67-f327-4cfa-b273-75e7ea6ec543 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840" status: 200 len: 1244 microversion: 2.1 time: 0.141408 Aug 31 01:22:57.039408 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 28/58] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:22:56 2022] GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840 => generated 1244 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:22:57.050335 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-38fa966b-81b2-445d-9ccb-badda6793248 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d058c2b40343a6a3e2e46f6b2bab0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb95e8d0a84b76a5d141815451ceae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:22:57.059772 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-38fa966b-81b2-445d-9ccb-badda6793248 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] 10.222.0.20 "GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5" status: 200 len: 1313 microversion: 2.1 time: 0.301176 Aug 31 01:22:57.069145 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 31/59] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:22:56 2022] GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5 => generated 1313 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:22:57.217541 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-05c68d80-42c2-4f64-8d11-f732525ccc2e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:57.218166 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-05c68d80-42c2-4f64-8d11-f732525ccc2e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:22:57.225662 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-05c68d80-42c2-4f64-8d11-f732525ccc2e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:57.226160 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-05c68d80-42c2-4f64-8d11-f732525ccc2e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:57.226581 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-05c68d80-42c2-4f64-8d11-f732525ccc2e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:57.227312 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-05c68d80-42c2-4f64-8d11-f732525ccc2e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:57.227761 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-05c68d80-42c2-4f64-8d11-f732525ccc2e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:57.228179 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-05c68d80-42c2-4f64-8d11-f732525ccc2e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:57.375555 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-05c68d80-42c2-4f64-8d11-f732525ccc2e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:22:57.384422 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-05c68d80-42c2-4f64-8d11-f732525ccc2e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 200 len: 1321 microversion: 2.1 time: 0.170628 Aug 31 01:22:57.386687 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 29/60] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:22:57 2022] GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:22:57.740889 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-c0f185ff-37e4-488f-a3b1-948b3ec51c2f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:57.741608 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-c0f185ff-37e4-488f-a3b1-948b3ec51c2f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:22:57.794611 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-c0f185ff-37e4-488f-a3b1-948b3ec51c2f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:22:57.803094 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-c0f185ff-37e4-488f-a3b1-948b3ec51c2f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:22:57.804882 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-c0f185ff-37e4-488f-a3b1-948b3ec51c2f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:22:57.805955 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-c0f185ff-37e4-488f-a3b1-948b3ec51c2f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1282 microversion: 2.20 time: 0.070282 Aug 31 01:22:57.806515 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 32/61] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:22:57 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1282 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:22:58.059738 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-7d0eabda-c625-4e8e-a6ee-3110c3393961 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:58.060449 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-7d0eabda-c625-4e8e-a6ee-3110c3393961 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 8ce564c8-7a17-4de1-96b9-3737fca73840] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:22:58.066802 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7d0eabda-c625-4e8e-a6ee-3110c3393961 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:58.067516 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7d0eabda-c625-4e8e-a6ee-3110c3393961 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:58.068047 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7d0eabda-c625-4e8e-a6ee-3110c3393961 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:58.068740 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7d0eabda-c625-4e8e-a6ee-3110c3393961 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:58.069195 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7d0eabda-c625-4e8e-a6ee-3110c3393961 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:58.069834 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7d0eabda-c625-4e8e-a6ee-3110c3393961 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:58.081229 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-c887d1d9-6bc9-42cd-8f9d-45b5e8f33c8b tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:58.081856 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-c887d1d9-6bc9-42cd-8f9d-45b5e8f33c8b tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] [instance: 3f2e4287-f02a-4d2f-a669-621ae355fce5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:22:58.098421 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c887d1d9-6bc9-42cd-8f9d-45b5e8f33c8b tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:58.099104 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c887d1d9-6bc9-42cd-8f9d-45b5e8f33c8b tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:58.099532 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c887d1d9-6bc9-42cd-8f9d-45b5e8f33c8b tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:58.100903 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c887d1d9-6bc9-42cd-8f9d-45b5e8f33c8b tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:58.101355 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c887d1d9-6bc9-42cd-8f9d-45b5e8f33c8b tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:58.101770 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c887d1d9-6bc9-42cd-8f9d-45b5e8f33c8b tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:58.210224 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-7d0eabda-c625-4e8e-a6ee-3110c3393961 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:22:58.222947 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-7d0eabda-c625-4e8e-a6ee-3110c3393961 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840" status: 200 len: 1244 microversion: 2.1 time: 0.165471 Aug 31 01:22:58.226307 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 30/62] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:22:58 2022] GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840 => generated 1244 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:22:58.340903 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-c887d1d9-6bc9-42cd-8f9d-45b5e8f33c8b tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d058c2b40343a6a3e2e46f6b2bab0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb95e8d0a84b76a5d141815451ceae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:22:58.351481 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-c887d1d9-6bc9-42cd-8f9d-45b5e8f33c8b tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] 10.222.0.20 "GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5" status: 200 len: 1313 microversion: 2.1 time: 0.274442 Aug 31 01:22:58.356838 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 33/63] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:22:58 2022] GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5 => generated 1313 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:22:58.415020 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [req-47a92471-c661-4b41-badf-231862f8f938 req-be022a96-6901-4b84-950a-b7d084dcd5a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bee91462-f582-40c7-88f9-652f75ce8b01", "tag": "81d2c012-27ea-4e66-96da-4c03afd30650"}]} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:22:58.416922 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-8ac34bd4-302d-40c4-8c8e-b4cfaedaa332 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:58.421707 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-8ac34bd4-302d-40c4-8c8e-b4cfaedaa332 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:22:58.446008 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-47a92471-c661-4b41-badf-231862f8f938 req-be022a96-6901-4b84-950a-b7d084dcd5a4 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:58.446491 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-47a92471-c661-4b41-badf-231862f8f938 req-be022a96-6901-4b84-950a-b7d084dcd5a4 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:58.447006 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-47a92471-c661-4b41-badf-231862f8f938 req-be022a96-6901-4b84-950a-b7d084dcd5a4 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:58.448270 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8ac34bd4-302d-40c4-8c8e-b4cfaedaa332 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:58.449259 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8ac34bd4-302d-40c4-8c8e-b4cfaedaa332 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:58.450398 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8ac34bd4-302d-40c4-8c8e-b4cfaedaa332 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:58.452410 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8ac34bd4-302d-40c4-8c8e-b4cfaedaa332 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:58.455894 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8ac34bd4-302d-40c4-8c8e-b4cfaedaa332 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:58.456480 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8ac34bd4-302d-40c4-8c8e-b4cfaedaa332 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:58.478090 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.compute.server_external_events [req-47a92471-c661-4b41-badf-231862f8f938 req-be022a96-6901-4b84-950a-b7d084dcd5a4 service nova] Creating event network-changed:81d2c012-27ea-4e66-96da-4c03afd30650 for instance bee91462-f582-40c7-88f9-652f75ce8b01 on hv-cinder-85528 Aug 31 01:22:58.490848 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [req-47a92471-c661-4b41-badf-231862f8f938 req-be022a96-6901-4b84-950a-b7d084dcd5a4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079464 Aug 31 01:22:58.492074 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 34/64] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:22:58.663433 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-8ac34bd4-302d-40c4-8c8e-b4cfaedaa332 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:22:58.674552 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-8ac34bd4-302d-40c4-8c8e-b4cfaedaa332 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 200 len: 1321 microversion: 2.1 time: 0.271672 Aug 31 01:22:58.675160 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 31/65] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:22:58 2022] GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 1321 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:22:58.831848 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-b12ce4f7-5d8c-496a-b759-582657ad5e1f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:58.832563 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-b12ce4f7-5d8c-496a-b759-582657ad5e1f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:22:58.839854 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b12ce4f7-5d8c-496a-b759-582657ad5e1f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:58.840339 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b12ce4f7-5d8c-496a-b759-582657ad5e1f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:58.840851 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b12ce4f7-5d8c-496a-b759-582657ad5e1f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:58.846734 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b12ce4f7-5d8c-496a-b759-582657ad5e1f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:58.846734 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b12ce4f7-5d8c-496a-b759-582657ad5e1f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:58.846734 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b12ce4f7-5d8c-496a-b759-582657ad5e1f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:58.919318 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-b12ce4f7-5d8c-496a-b759-582657ad5e1f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:22:58.929146 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-b12ce4f7-5d8c-496a-b759-582657ad5e1f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:22:58.930757 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-b12ce4f7-5d8c-496a-b759-582657ad5e1f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:22:58.933722 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-b12ce4f7-5d8c-496a-b759-582657ad5e1f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1278 microversion: 2.20 time: 0.106144 Aug 31 01:22:58.933722 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 35/66] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:22:58 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1278 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:22:59.244472 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-0d043899-4664-4c99-9997-a28783b00401 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:59.245117 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-0d043899-4664-4c99-9997-a28783b00401 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 8ce564c8-7a17-4de1-96b9-3737fca73840] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:22:59.252315 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0d043899-4664-4c99-9997-a28783b00401 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:59.252828 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0d043899-4664-4c99-9997-a28783b00401 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:59.253330 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0d043899-4664-4c99-9997-a28783b00401 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:59.254325 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0d043899-4664-4c99-9997-a28783b00401 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:59.255000 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0d043899-4664-4c99-9997-a28783b00401 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:59.255437 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0d043899-4664-4c99-9997-a28783b00401 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:59.322943 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-0d043899-4664-4c99-9997-a28783b00401 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:22:59.331065 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-0d043899-4664-4c99-9997-a28783b00401 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840" status: 200 len: 1292 microversion: 2.1 time: 0.091479 Aug 31 01:22:59.331742 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 32/67] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:22:59 2022] GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840 => generated 1292 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:22:59.376177 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-5abca940-0092-4163-bcd1-d2437002a6bc tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:59.381746 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-5abca940-0092-4163-bcd1-d2437002a6bc tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] [instance: 3f2e4287-f02a-4d2f-a669-621ae355fce5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:22:59.383722 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5abca940-0092-4163-bcd1-d2437002a6bc tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:59.384205 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5abca940-0092-4163-bcd1-d2437002a6bc tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:59.384837 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5abca940-0092-4163-bcd1-d2437002a6bc tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:59.385559 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5abca940-0092-4163-bcd1-d2437002a6bc tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:59.386016 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5abca940-0092-4163-bcd1-d2437002a6bc tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:59.386470 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5abca940-0092-4163-bcd1-d2437002a6bc tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:59.581153 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-5abca940-0092-4163-bcd1-d2437002a6bc tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d058c2b40343a6a3e2e46f6b2bab0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb95e8d0a84b76a5d141815451ceae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:22:59.596857 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-5abca940-0092-4163-bcd1-d2437002a6bc tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] 10.222.0.20 "GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5" status: 200 len: 1313 microversion: 2.1 time: 0.221838 Aug 31 01:22:59.596857 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 36/68] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:22:59 2022] GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:22:59.696527 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-b9c01a50-6681-4b29-9a8c-acf3dd74735f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:59.697183 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-b9c01a50-6681-4b29-9a8c-acf3dd74735f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:22:59.705846 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b9c01a50-6681-4b29-9a8c-acf3dd74735f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:59.706341 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b9c01a50-6681-4b29-9a8c-acf3dd74735f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:59.706762 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b9c01a50-6681-4b29-9a8c-acf3dd74735f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:59.711644 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b9c01a50-6681-4b29-9a8c-acf3dd74735f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:59.714025 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b9c01a50-6681-4b29-9a8c-acf3dd74735f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:59.714635 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b9c01a50-6681-4b29-9a8c-acf3dd74735f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:59.719562 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell1:SELECT=93 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:22:59.902655 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-b9c01a50-6681-4b29-9a8c-acf3dd74735f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:22:59.911541 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-b9c01a50-6681-4b29-9a8c-acf3dd74735f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 200 len: 1321 microversion: 2.1 time: 0.219417 Aug 31 01:22:59.912914 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 33/69] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:22:59 2022] GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:22:59.955985 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-598e4890-7feb-4b68-92c9-08af45fdbf63 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:22:59.964645 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-598e4890-7feb-4b68-92c9-08af45fdbf63 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:22:59.964645 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-598e4890-7feb-4b68-92c9-08af45fdbf63 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:59.965079 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-598e4890-7feb-4b68-92c9-08af45fdbf63 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:59.965630 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-598e4890-7feb-4b68-92c9-08af45fdbf63 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:22:59.966566 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-598e4890-7feb-4b68-92c9-08af45fdbf63 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:22:59.967588 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-598e4890-7feb-4b68-92c9-08af45fdbf63 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:22:59.968365 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-598e4890-7feb-4b68-92c9-08af45fdbf63 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:00.042692 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-598e4890-7feb-4b68-92c9-08af45fdbf63 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:00.056490 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-598e4890-7feb-4b68-92c9-08af45fdbf63 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:00.056490 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-598e4890-7feb-4b68-92c9-08af45fdbf63 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:00.056740 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-598e4890-7feb-4b68-92c9-08af45fdbf63 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1334 microversion: 2.20 time: 0.104695 Aug 31 01:23:00.057497 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 37/70] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:22:59 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1334 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:23:00.355981 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-a96f91a7-2c1d-40a6-9f0e-da9e11672fc3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:00.355981 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-a96f91a7-2c1d-40a6-9f0e-da9e11672fc3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 8ce564c8-7a17-4de1-96b9-3737fca73840] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:00.360567 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a96f91a7-2c1d-40a6-9f0e-da9e11672fc3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:00.361230 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a96f91a7-2c1d-40a6-9f0e-da9e11672fc3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:00.361739 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a96f91a7-2c1d-40a6-9f0e-da9e11672fc3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:00.362452 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a96f91a7-2c1d-40a6-9f0e-da9e11672fc3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:00.362904 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a96f91a7-2c1d-40a6-9f0e-da9e11672fc3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:00.363359 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a96f91a7-2c1d-40a6-9f0e-da9e11672fc3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:00.432627 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-a96f91a7-2c1d-40a6-9f0e-da9e11672fc3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:00.440670 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-a96f91a7-2c1d-40a6-9f0e-da9e11672fc3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840" status: 200 len: 1300 microversion: 2.1 time: 0.091312 Aug 31 01:23:00.448946 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 34/71] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:00 2022] GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840 => generated 1300 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:00.616281 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-f3b24337-f37a-468e-9691-148da652fb71 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:00.617261 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-f3b24337-f37a-468e-9691-148da652fb71 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] [instance: 3f2e4287-f02a-4d2f-a669-621ae355fce5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:00.626924 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f3b24337-f37a-468e-9691-148da652fb71 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:00.627702 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f3b24337-f37a-468e-9691-148da652fb71 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:00.628350 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f3b24337-f37a-468e-9691-148da652fb71 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:00.629302 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f3b24337-f37a-468e-9691-148da652fb71 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:00.629962 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f3b24337-f37a-468e-9691-148da652fb71 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:00.631609 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f3b24337-f37a-468e-9691-148da652fb71 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:00.933614 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-ed491850-3b5a-4eb9-a6ab-c7ed4c290eee tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:00.934320 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-ed491850-3b5a-4eb9-a6ab-c7ed4c290eee tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:00.951621 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ed491850-3b5a-4eb9-a6ab-c7ed4c290eee tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:00.952388 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ed491850-3b5a-4eb9-a6ab-c7ed4c290eee tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:00.952613 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ed491850-3b5a-4eb9-a6ab-c7ed4c290eee tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:00.953538 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ed491850-3b5a-4eb9-a6ab-c7ed4c290eee tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:00.954609 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ed491850-3b5a-4eb9-a6ab-c7ed4c290eee tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:00.956830 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ed491850-3b5a-4eb9-a6ab-c7ed4c290eee tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:01.176973 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-f3b24337-f37a-468e-9691-148da652fb71 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d058c2b40343a6a3e2e46f6b2bab0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb95e8d0a84b76a5d141815451ceae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:01.186972 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-f3b24337-f37a-468e-9691-148da652fb71 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] 10.222.0.20 "GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5" status: 200 len: 1313 microversion: 2.1 time: 0.574953 Aug 31 01:23:01.192618 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 38/72] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:00 2022] GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5 => generated 1313 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:01.215363 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-d4c0e3f3-c017-45b3-90df-30edc4eae391 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:01.217212 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-d4c0e3f3-c017-45b3-90df-30edc4eae391 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:01.231548 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d4c0e3f3-c017-45b3-90df-30edc4eae391 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:01.233833 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d4c0e3f3-c017-45b3-90df-30edc4eae391 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:01.235092 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d4c0e3f3-c017-45b3-90df-30edc4eae391 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:01.237551 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d4c0e3f3-c017-45b3-90df-30edc4eae391 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:01.238107 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d4c0e3f3-c017-45b3-90df-30edc4eae391 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:01.238995 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d4c0e3f3-c017-45b3-90df-30edc4eae391 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:01.363970 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-d4c0e3f3-c017-45b3-90df-30edc4eae391 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:01.374156 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-d4c0e3f3-c017-45b3-90df-30edc4eae391 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:01.375666 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-d4c0e3f3-c017-45b3-90df-30edc4eae391 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:01.377149 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-d4c0e3f3-c017-45b3-90df-30edc4eae391 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1352 microversion: 2.20 time: 0.182463 Aug 31 01:23:01.378594 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 39/73] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:23:01 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1352 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:23:01.463553 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-845d7d5b-ecb9-45d6-9095-05e3428f8628 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:01.464344 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-845d7d5b-ecb9-45d6-9095-05e3428f8628 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 8ce564c8-7a17-4de1-96b9-3737fca73840] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:01.471526 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-845d7d5b-ecb9-45d6-9095-05e3428f8628 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:01.472018 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-845d7d5b-ecb9-45d6-9095-05e3428f8628 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:01.472457 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-845d7d5b-ecb9-45d6-9095-05e3428f8628 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:01.473190 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-845d7d5b-ecb9-45d6-9095-05e3428f8628 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:01.473722 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-845d7d5b-ecb9-45d6-9095-05e3428f8628 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:01.474435 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-845d7d5b-ecb9-45d6-9095-05e3428f8628 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:01.652635 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-ed491850-3b5a-4eb9-a6ab-c7ed4c290eee tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:01.664496 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-ed491850-3b5a-4eb9-a6ab-c7ed4c290eee tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 200 len: 1321 microversion: 2.1 time: 0.734883 Aug 31 01:23:01.668778 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 35/74] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:00 2022] GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 1321 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:01.706472 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-845d7d5b-ecb9-45d6-9095-05e3428f8628 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:01.722663 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-845d7d5b-ecb9-45d6-9095-05e3428f8628 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840" status: 200 len: 1310 microversion: 2.1 time: 0.262982 Aug 31 01:23:01.723542 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 40/75] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:01 2022] GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840 => generated 1310 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:23:02.216484 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-fdcc2b2d-323b-4d3a-a010-cbebb58c2738 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:02.217032 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-fdcc2b2d-323b-4d3a-a010-cbebb58c2738 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] [instance: 3f2e4287-f02a-4d2f-a669-621ae355fce5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:02.222865 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fdcc2b2d-323b-4d3a-a010-cbebb58c2738 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:02.223336 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fdcc2b2d-323b-4d3a-a010-cbebb58c2738 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:02.223756 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fdcc2b2d-323b-4d3a-a010-cbebb58c2738 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:02.224428 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fdcc2b2d-323b-4d3a-a010-cbebb58c2738 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:02.225406 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fdcc2b2d-323b-4d3a-a010-cbebb58c2738 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:02.225816 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fdcc2b2d-323b-4d3a-a010-cbebb58c2738 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:02.355748 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-fdcc2b2d-323b-4d3a-a010-cbebb58c2738 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d058c2b40343a6a3e2e46f6b2bab0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb95e8d0a84b76a5d141815451ceae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:02.366233 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-fdcc2b2d-323b-4d3a-a010-cbebb58c2738 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] 10.222.0.20 "GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5" status: 200 len: 1313 microversion: 2.1 time: 0.152214 Aug 31 01:23:02.366233 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 36/76] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:02 2022] GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:02.404334 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-bba70791-dc30-4e64-9bf3-81e261d08b09 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:02.404994 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-bba70791-dc30-4e64-9bf3-81e261d08b09 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:02.437180 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-bba70791-dc30-4e64-9bf3-81e261d08b09 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:02.437180 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-bba70791-dc30-4e64-9bf3-81e261d08b09 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:02.438201 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-bba70791-dc30-4e64-9bf3-81e261d08b09 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:02.439992 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-bba70791-dc30-4e64-9bf3-81e261d08b09 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:02.442434 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-bba70791-dc30-4e64-9bf3-81e261d08b09 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:02.444825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-bba70791-dc30-4e64-9bf3-81e261d08b09 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:02.620853 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-bba70791-dc30-4e64-9bf3-81e261d08b09 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:02.635709 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-bba70791-dc30-4e64-9bf3-81e261d08b09 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:02.638370 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-bba70791-dc30-4e64-9bf3-81e261d08b09 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:02.642071 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-bba70791-dc30-4e64-9bf3-81e261d08b09 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1340 microversion: 2.20 time: 0.242210 Aug 31 01:23:02.645867 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 41/77] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:23:02 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1340 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:23:02.685971 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-81816e82-76cd-4d26-aa4a-795ce5cb2276 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:02.687319 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-81816e82-76cd-4d26-aa4a-795ce5cb2276 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:02.695741 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-81816e82-76cd-4d26-aa4a-795ce5cb2276 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:02.701490 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-81816e82-76cd-4d26-aa4a-795ce5cb2276 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:02.701490 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-81816e82-76cd-4d26-aa4a-795ce5cb2276 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:02.701490 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-81816e82-76cd-4d26-aa4a-795ce5cb2276 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:02.701490 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-81816e82-76cd-4d26-aa4a-795ce5cb2276 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:02.702084 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-81816e82-76cd-4d26-aa4a-795ce5cb2276 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:02.744848 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-d3679c81-9e5b-4bb1-bcff-a48e233c65d6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:02.745664 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-d3679c81-9e5b-4bb1-bcff-a48e233c65d6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 8ce564c8-7a17-4de1-96b9-3737fca73840] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:02.756619 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d3679c81-9e5b-4bb1-bcff-a48e233c65d6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:02.761715 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d3679c81-9e5b-4bb1-bcff-a48e233c65d6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:02.764560 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d3679c81-9e5b-4bb1-bcff-a48e233c65d6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:02.764980 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d3679c81-9e5b-4bb1-bcff-a48e233c65d6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:02.766392 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d3679c81-9e5b-4bb1-bcff-a48e233c65d6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:02.767000 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d3679c81-9e5b-4bb1-bcff-a48e233c65d6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:03.002545 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-d3679c81-9e5b-4bb1-bcff-a48e233c65d6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:03.021754 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-d3679c81-9e5b-4bb1-bcff-a48e233c65d6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840" status: 200 len: 1298 microversion: 2.1 time: 0.281018 Aug 31 01:23:03.029760 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 42/78] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:02 2022] GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840 => generated 1298 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:23:03.216316 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-81816e82-76cd-4d26-aa4a-795ce5cb2276 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:03.225169 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-81816e82-76cd-4d26-aa4a-795ce5cb2276 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 200 len: 1321 microversion: 2.1 time: 0.544407 Aug 31 01:23:03.226787 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 37/79] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:02 2022] GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 1321 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:03.345038 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [req-acd91fff-4b20-4d7a-a2d7-94614612ef13 req-7748f905-3e80-40e5-b7c9-363c8b71b446 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f2e4287-f02a-4d2f-a669-621ae355fce5", "name": "network-vif-plugged", "status": "completed", "tag": "c7dd3835-d8c2-4dee-8cb0-6f3061af7f54"}]} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:23:03.368937 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-acd91fff-4b20-4d7a-a2d7-94614612ef13 req-7748f905-3e80-40e5-b7c9-363c8b71b446 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:03.369554 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-acd91fff-4b20-4d7a-a2d7-94614612ef13 req-7748f905-3e80-40e5-b7c9-363c8b71b446 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:03.370390 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-acd91fff-4b20-4d7a-a2d7-94614612ef13 req-7748f905-3e80-40e5-b7c9-363c8b71b446 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:03.386809 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-7ae5a000-6e7e-4a0b-843e-46f79216cb61 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:03.387551 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-7ae5a000-6e7e-4a0b-843e-46f79216cb61 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] [instance: 3f2e4287-f02a-4d2f-a669-621ae355fce5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:03.397566 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7ae5a000-6e7e-4a0b-843e-46f79216cb61 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:03.402637 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7ae5a000-6e7e-4a0b-843e-46f79216cb61 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:03.407220 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7ae5a000-6e7e-4a0b-843e-46f79216cb61 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:03.409625 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7ae5a000-6e7e-4a0b-843e-46f79216cb61 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:03.410761 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7ae5a000-6e7e-4a0b-843e-46f79216cb61 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:03.412976 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7ae5a000-6e7e-4a0b-843e-46f79216cb61 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:03.415519 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.compute.server_external_events [req-acd91fff-4b20-4d7a-a2d7-94614612ef13 req-7748f905-3e80-40e5-b7c9-363c8b71b446 service nova] Creating event network-vif-plugged:c7dd3835-d8c2-4dee-8cb0-6f3061af7f54 for instance 3f2e4287-f02a-4d2f-a669-621ae355fce5 on hv-cinder-85528 Aug 31 01:23:03.442832 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [req-acd91fff-4b20-4d7a-a2d7-94614612ef13 req-7748f905-3e80-40e5-b7c9-363c8b71b446 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.409935 Aug 31 01:23:03.446934 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 43/80] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:23:03.672146 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-c43de4c6-9806-467b-a629-e7a73c2b6649 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:03.676556 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-c43de4c6-9806-467b-a629-e7a73c2b6649 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:03.686864 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c43de4c6-9806-467b-a629-e7a73c2b6649 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:03.687863 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c43de4c6-9806-467b-a629-e7a73c2b6649 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:03.688311 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c43de4c6-9806-467b-a629-e7a73c2b6649 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:03.691772 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c43de4c6-9806-467b-a629-e7a73c2b6649 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:03.692269 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c43de4c6-9806-467b-a629-e7a73c2b6649 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:03.692702 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c43de4c6-9806-467b-a629-e7a73c2b6649 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:03.706126 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell1:SELECT=100 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:23:03.867337 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-7ae5a000-6e7e-4a0b-843e-46f79216cb61 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d058c2b40343a6a3e2e46f6b2bab0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb95e8d0a84b76a5d141815451ceae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:03.869992 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-c43de4c6-9806-467b-a629-e7a73c2b6649 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:03.900113 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-7ae5a000-6e7e-4a0b-843e-46f79216cb61 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] 10.222.0.20 "GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5" status: 200 len: 1313 microversion: 2.1 time: 0.511403 Aug 31 01:23:03.900113 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 38/81] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:03 2022] GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5 => generated 1313 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:23:03.900896 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-c43de4c6-9806-467b-a629-e7a73c2b6649 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:03.902162 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-c43de4c6-9806-467b-a629-e7a73c2b6649 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:03.903746 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-c43de4c6-9806-467b-a629-e7a73c2b6649 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1340 microversion: 2.20 time: 0.236483 Aug 31 01:23:03.916747 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 44/82] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:23:03 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1340 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:23:04.058854 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-6ef2b0f6-6946-4e77-8e34-87106f1e8f0d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:04.059744 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-6ef2b0f6-6946-4e77-8e34-87106f1e8f0d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 8ce564c8-7a17-4de1-96b9-3737fca73840] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:04.069979 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6ef2b0f6-6946-4e77-8e34-87106f1e8f0d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:04.071769 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6ef2b0f6-6946-4e77-8e34-87106f1e8f0d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:04.073711 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6ef2b0f6-6946-4e77-8e34-87106f1e8f0d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:04.074601 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6ef2b0f6-6946-4e77-8e34-87106f1e8f0d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:04.077209 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6ef2b0f6-6946-4e77-8e34-87106f1e8f0d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:04.077570 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6ef2b0f6-6946-4e77-8e34-87106f1e8f0d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:04.246644 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-766410d4-86ca-442b-8aed-bec3d8e3a7e1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:04.247666 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-766410d4-86ca-442b-8aed-bec3d8e3a7e1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:04.255339 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-766410d4-86ca-442b-8aed-bec3d8e3a7e1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:04.261442 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-766410d4-86ca-442b-8aed-bec3d8e3a7e1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:04.262144 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-766410d4-86ca-442b-8aed-bec3d8e3a7e1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:04.263795 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-766410d4-86ca-442b-8aed-bec3d8e3a7e1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:04.267108 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-766410d4-86ca-442b-8aed-bec3d8e3a7e1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:04.271093 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-766410d4-86ca-442b-8aed-bec3d8e3a7e1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:04.462870 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-6ef2b0f6-6946-4e77-8e34-87106f1e8f0d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:04.475053 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-6ef2b0f6-6946-4e77-8e34-87106f1e8f0d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840" status: 200 len: 1364 microversion: 2.1 time: 0.424166 Aug 31 01:23:04.483179 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 39/83] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:04 2022] GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840 => generated 1364 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:04.549709 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-766410d4-86ca-442b-8aed-bec3d8e3a7e1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:04.559529 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-766410d4-86ca-442b-8aed-bec3d8e3a7e1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 200 len: 1321 microversion: 2.1 time: 0.316329 Aug 31 01:23:04.561168 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 45/84] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:04 2022] GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 1321 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:23:04.918281 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-f0b4ccd1-f1e6-46e6-8578-e1dab298f571 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:04.919596 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-f0b4ccd1-f1e6-46e6-8578-e1dab298f571 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] [instance: 3f2e4287-f02a-4d2f-a669-621ae355fce5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:04.925874 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f0b4ccd1-f1e6-46e6-8578-e1dab298f571 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:04.932683 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f0b4ccd1-f1e6-46e6-8578-e1dab298f571 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:04.932683 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f0b4ccd1-f1e6-46e6-8578-e1dab298f571 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:04.932683 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f0b4ccd1-f1e6-46e6-8578-e1dab298f571 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:04.932683 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f0b4ccd1-f1e6-46e6-8578-e1dab298f571 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:04.933189 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f0b4ccd1-f1e6-46e6-8578-e1dab298f571 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:04.933285 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-7b6ad111-1476-4213-b67f-acd7c483b2bc tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:04.934228 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-7b6ad111-1476-4213-b67f-acd7c483b2bc tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:04.946556 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7b6ad111-1476-4213-b67f-acd7c483b2bc tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:04.948835 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7b6ad111-1476-4213-b67f-acd7c483b2bc tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:04.949466 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7b6ad111-1476-4213-b67f-acd7c483b2bc tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:04.952115 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7b6ad111-1476-4213-b67f-acd7c483b2bc tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:04.953322 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7b6ad111-1476-4213-b67f-acd7c483b2bc tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:04.957502 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7b6ad111-1476-4213-b67f-acd7c483b2bc tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:05.280293 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-f0b4ccd1-f1e6-46e6-8578-e1dab298f571 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d058c2b40343a6a3e2e46f6b2bab0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb95e8d0a84b76a5d141815451ceae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:05.288717 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-f0b4ccd1-f1e6-46e6-8578-e1dab298f571 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] 10.222.0.20 "GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5" status: 200 len: 1313 microversion: 2.1 time: 0.374380 Aug 31 01:23:05.289317 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 40/85] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:04 2022] GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5 => generated 1313 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:05.295771 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-7b6ad111-1476-4213-b67f-acd7c483b2bc tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:05.319441 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-e08b4825-813e-46b4-b7ad-9429917c44ff req-323c61cc-306f-4de3-92a7-c1c4318e7465 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ce564c8-7a17-4de1-96b9-3737fca73840", "tag": "06a28bab-3d45-4348-850c-bb3c714f41df"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:23:05.335922 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-7b6ad111-1476-4213-b67f-acd7c483b2bc tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:05.348338 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-7b6ad111-1476-4213-b67f-acd7c483b2bc tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:05.353728 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-e08b4825-813e-46b4-b7ad-9429917c44ff req-323c61cc-306f-4de3-92a7-c1c4318e7465 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:05.359012 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-7b6ad111-1476-4213-b67f-acd7c483b2bc tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1408 microversion: 2.20 time: 0.429451 Aug 31 01:23:05.359012 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 46/86] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:23:04 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1408 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 01:23:05.359221 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-e08b4825-813e-46b4-b7ad-9429917c44ff req-323c61cc-306f-4de3-92a7-c1c4318e7465 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:05.359221 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-e08b4825-813e-46b4-b7ad-9429917c44ff req-323c61cc-306f-4de3-92a7-c1c4318e7465 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:05.381605 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-e08b4825-813e-46b4-b7ad-9429917c44ff req-323c61cc-306f-4de3-92a7-c1c4318e7465 service nova] Creating event network-changed:06a28bab-3d45-4348-850c-bb3c714f41df for instance 8ce564c8-7a17-4de1-96b9-3737fca73840 on hv-cinder-85528 Aug 31 01:23:05.389448 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-e08b4825-813e-46b4-b7ad-9429917c44ff req-323c61cc-306f-4de3-92a7-c1c4318e7465 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098934 Aug 31 01:23:05.390619 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 41/87] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:23:05.462186 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [req-901f1ba5-f619-4521-9512-5aef3e955019 req-c8036e43-e620-49a2-98f3-2d6769f35fbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee6ca45e-29c7-4af8-8aef-72134f23292c", "name": "network-vif-plugged", "status": "completed", "tag": "388de9da-77e7-4d40-9542-da91eb9630e0"}, {"server_uuid": "bee91462-f582-40c7-88f9-652f75ce8b01", "name": "network-vif-plugged", "status": "completed", "tag": "81d2c012-27ea-4e66-96da-4c03afd30650"}]} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:23:05.479466 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-901f1ba5-f619-4521-9512-5aef3e955019 req-c8036e43-e620-49a2-98f3-2d6769f35fbe service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:05.485300 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-901f1ba5-f619-4521-9512-5aef3e955019 req-c8036e43-e620-49a2-98f3-2d6769f35fbe service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:05.485300 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-901f1ba5-f619-4521-9512-5aef3e955019 req-c8036e43-e620-49a2-98f3-2d6769f35fbe service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:05.500298 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.compute.server_external_events [req-901f1ba5-f619-4521-9512-5aef3e955019 req-c8036e43-e620-49a2-98f3-2d6769f35fbe service nova] Creating event network-vif-plugged:388de9da-77e7-4d40-9542-da91eb9630e0 for instance ee6ca45e-29c7-4af8-8aef-72134f23292c on hv-cinder-85528 Aug 31 01:23:05.500996 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.compute.server_external_events [req-901f1ba5-f619-4521-9512-5aef3e955019 req-c8036e43-e620-49a2-98f3-2d6769f35fbe service nova] Creating event network-vif-plugged:81d2c012-27ea-4e66-96da-4c03afd30650 for instance bee91462-f582-40c7-88f9-652f75ce8b01 on hv-cinder-85528 Aug 31 01:23:05.517995 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-67aa0feb-2d69-4f07-ac48-8ec1f6afb00f tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:05.518714 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-67aa0feb-2d69-4f07-ac48-8ec1f6afb00f tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 8ce564c8-7a17-4de1-96b9-3737fca73840] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:05.528170 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [req-901f1ba5-f619-4521-9512-5aef3e955019 req-c8036e43-e620-49a2-98f3-2d6769f35fbe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.071717 Aug 31 01:23:05.533862 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-67aa0feb-2d69-4f07-ac48-8ec1f6afb00f tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:05.536864 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 47/88] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:23:05.536999 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-67aa0feb-2d69-4f07-ac48-8ec1f6afb00f tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:05.544858 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-67aa0feb-2d69-4f07-ac48-8ec1f6afb00f tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:05.546004 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-67aa0feb-2d69-4f07-ac48-8ec1f6afb00f tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:05.546711 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-67aa0feb-2d69-4f07-ac48-8ec1f6afb00f tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:05.548357 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-67aa0feb-2d69-4f07-ac48-8ec1f6afb00f tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:05.562250 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [req-5b3efff2-8a72-4f1d-9416-8bdb410c6320 req-83a6a67d-3dda-459f-8d6d-21802413bf8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12814f73-696a-4dc2-9182-7779bfe90ad5", "tag": "dc60a507-f9d6-4b68-ae6c-65c2cfafb12c"}]} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:23:05.594764 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-5b3efff2-8a72-4f1d-9416-8bdb410c6320 req-83a6a67d-3dda-459f-8d6d-21802413bf8a service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:05.594764 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-5b3efff2-8a72-4f1d-9416-8bdb410c6320 req-83a6a67d-3dda-459f-8d6d-21802413bf8a service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:05.594764 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-5b3efff2-8a72-4f1d-9416-8bdb410c6320 req-83a6a67d-3dda-459f-8d6d-21802413bf8a service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:05.623886 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.compute.server_external_events [req-5b3efff2-8a72-4f1d-9416-8bdb410c6320 req-83a6a67d-3dda-459f-8d6d-21802413bf8a service nova] Creating event network-changed:dc60a507-f9d6-4b68-ae6c-65c2cfafb12c for instance 12814f73-696a-4dc2-9182-7779bfe90ad5 on hv-cinder-85528 Aug 31 01:23:05.638609 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [req-5b3efff2-8a72-4f1d-9416-8bdb410c6320 req-83a6a67d-3dda-459f-8d6d-21802413bf8a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081214 Aug 31 01:23:05.640405 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 48/89] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:23:05.646360 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-833a1475-9c02-4ac0-b003-479fadb4c1c4 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:05.647872 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-833a1475-9c02-4ac0-b003-479fadb4c1c4 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:05.680412 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-833a1475-9c02-4ac0-b003-479fadb4c1c4 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:05.685843 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-833a1475-9c02-4ac0-b003-479fadb4c1c4 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:05.689108 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-833a1475-9c02-4ac0-b003-479fadb4c1c4 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:05.690058 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-833a1475-9c02-4ac0-b003-479fadb4c1c4 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:05.690708 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-833a1475-9c02-4ac0-b003-479fadb4c1c4 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:05.691570 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-833a1475-9c02-4ac0-b003-479fadb4c1c4 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:05.946765 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-67aa0feb-2d69-4f07-ac48-8ec1f6afb00f tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:05.963330 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-67aa0feb-2d69-4f07-ac48-8ec1f6afb00f tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840" status: 200 len: 1364 microversion: 2.1 time: 0.468556 Aug 31 01:23:05.963933 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 42/90] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:05 2022] GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840 => generated 1364 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:06.114220 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-833a1475-9c02-4ac0-b003-479fadb4c1c4 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:06.122508 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-833a1475-9c02-4ac0-b003-479fadb4c1c4 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 200 len: 1321 microversion: 2.1 time: 0.480583 Aug 31 01:23:06.125333 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 49/91] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:05 2022] GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 1321 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:06.311416 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-249ded93-4ec4-4c74-9047-d398b1890d9c tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:06.312101 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-249ded93-4ec4-4c74-9047-d398b1890d9c tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] [instance: 3f2e4287-f02a-4d2f-a669-621ae355fce5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:06.315136 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell0:SELECT=4 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:23:06.324649 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-249ded93-4ec4-4c74-9047-d398b1890d9c tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:06.325362 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-249ded93-4ec4-4c74-9047-d398b1890d9c tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:06.325806 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-249ded93-4ec4-4c74-9047-d398b1890d9c tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:06.326519 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-249ded93-4ec4-4c74-9047-d398b1890d9c tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:06.326975 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-249ded93-4ec4-4c74-9047-d398b1890d9c tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:06.327402 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-249ded93-4ec4-4c74-9047-d398b1890d9c tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:06.381984 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-cdc37f3e-bec2-470f-80f1-211485a17718 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:06.382688 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-cdc37f3e-bec2-470f-80f1-211485a17718 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:06.384871 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell0:SELECT=8 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:23:06.389802 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cdc37f3e-bec2-470f-80f1-211485a17718 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:06.390421 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cdc37f3e-bec2-470f-80f1-211485a17718 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:06.390939 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cdc37f3e-bec2-470f-80f1-211485a17718 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:06.391632 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cdc37f3e-bec2-470f-80f1-211485a17718 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:06.395911 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cdc37f3e-bec2-470f-80f1-211485a17718 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:06.395911 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cdc37f3e-bec2-470f-80f1-211485a17718 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:06.558956 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-249ded93-4ec4-4c74-9047-d398b1890d9c tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d058c2b40343a6a3e2e46f6b2bab0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb95e8d0a84b76a5d141815451ceae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:06.567578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-249ded93-4ec4-4c74-9047-d398b1890d9c tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] 10.222.0.20 "GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5" status: 200 len: 1313 microversion: 2.1 time: 0.259982 Aug 31 01:23:06.568153 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 43/92] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:06 2022] GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5 => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:06.607799 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-cdc37f3e-bec2-470f-80f1-211485a17718 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:06.618594 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-cdc37f3e-bec2-470f-80f1-211485a17718 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:06.621820 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-cdc37f3e-bec2-470f-80f1-211485a17718 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:06.623536 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-cdc37f3e-bec2-470f-80f1-211485a17718 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1408 microversion: 2.20 time: 0.245997 Aug 31 01:23:06.628187 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 50/93] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:23:06 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1408 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 01:23:06.981601 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell0:SELECT=28 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:23:06.986361 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-71d25494-ce2b-43a2-8de8-dbc68e7fb721 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:06.987226 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-71d25494-ce2b-43a2-8de8-dbc68e7fb721 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 8ce564c8-7a17-4de1-96b9-3737fca73840] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:07.000625 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-71d25494-ce2b-43a2-8de8-dbc68e7fb721 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:07.001150 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-71d25494-ce2b-43a2-8de8-dbc68e7fb721 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:07.001740 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-71d25494-ce2b-43a2-8de8-dbc68e7fb721 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:07.002583 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-71d25494-ce2b-43a2-8de8-dbc68e7fb721 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:07.003043 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-71d25494-ce2b-43a2-8de8-dbc68e7fb721 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:07.003465 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-71d25494-ce2b-43a2-8de8-dbc68e7fb721 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:07.138155 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-71d25494-ce2b-43a2-8de8-dbc68e7fb721 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:07.144906 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-d49df0c3-97b9-463f-95e4-7d522a80ccde tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:07.149357 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-d49df0c3-97b9-463f-95e4-7d522a80ccde tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:07.149464 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-71d25494-ce2b-43a2-8de8-dbc68e7fb721 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840" status: 200 len: 1364 microversion: 2.1 time: 0.165683 Aug 31 01:23:07.149464 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 44/94] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:06 2022] GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:07.158966 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d49df0c3-97b9-463f-95e4-7d522a80ccde tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:07.159454 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d49df0c3-97b9-463f-95e4-7d522a80ccde tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:07.160036 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d49df0c3-97b9-463f-95e4-7d522a80ccde tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:07.160749 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d49df0c3-97b9-463f-95e4-7d522a80ccde tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:07.161493 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d49df0c3-97b9-463f-95e4-7d522a80ccde tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:07.161926 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d49df0c3-97b9-463f-95e4-7d522a80ccde tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:07.300060 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-d49df0c3-97b9-463f-95e4-7d522a80ccde tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:07.308594 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-d49df0c3-97b9-463f-95e4-7d522a80ccde tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 200 len: 1321 microversion: 2.1 time: 0.168233 Aug 31 01:23:07.321449 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 51/95] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:07 2022] GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:07.591950 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-1824012f-7ba5-43a6-833e-cea7ee177724 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:07.592660 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-1824012f-7ba5-43a6-833e-cea7ee177724 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] [instance: 3f2e4287-f02a-4d2f-a669-621ae355fce5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:07.601069 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1824012f-7ba5-43a6-833e-cea7ee177724 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:07.601958 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1824012f-7ba5-43a6-833e-cea7ee177724 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:07.602560 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1824012f-7ba5-43a6-833e-cea7ee177724 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:07.605646 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1824012f-7ba5-43a6-833e-cea7ee177724 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:07.605646 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1824012f-7ba5-43a6-833e-cea7ee177724 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:07.605646 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1824012f-7ba5-43a6-833e-cea7ee177724 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:07.652710 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-35fc6d83-96e4-4eab-9cef-d6381d08bf8c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:07.653586 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-35fc6d83-96e4-4eab-9cef-d6381d08bf8c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:07.660142 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-35fc6d83-96e4-4eab-9cef-d6381d08bf8c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:07.660633 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-35fc6d83-96e4-4eab-9cef-d6381d08bf8c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:07.661089 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-35fc6d83-96e4-4eab-9cef-d6381d08bf8c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:07.661986 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-35fc6d83-96e4-4eab-9cef-d6381d08bf8c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:07.663000 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-35fc6d83-96e4-4eab-9cef-d6381d08bf8c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:07.663431 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-35fc6d83-96e4-4eab-9cef-d6381d08bf8c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:07.799401 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell0:SELECT=7 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:23:07.848216 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-1824012f-7ba5-43a6-833e-cea7ee177724 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d058c2b40343a6a3e2e46f6b2bab0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb95e8d0a84b76a5d141815451ceae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:07.861936 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-1824012f-7ba5-43a6-833e-cea7ee177724 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] 10.222.0.20 "GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5" status: 200 len: 1500 microversion: 2.1 time: 0.274903 Aug 31 01:23:07.862526 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 45/96] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:07 2022] GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5 => generated 1500 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:07.872612 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-35fc6d83-96e4-4eab-9cef-d6381d08bf8c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:07.880002 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-35fc6d83-96e4-4eab-9cef-d6381d08bf8c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:07.881503 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-35fc6d83-96e4-4eab-9cef-d6381d08bf8c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:07.882612 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-35fc6d83-96e4-4eab-9cef-d6381d08bf8c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1408 microversion: 2.20 time: 0.234156 Aug 31 01:23:07.883253 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 52/97] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:23:07 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1408 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 01:23:08.168231 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-09a46afe-cdf0-4f27-a671-0b8882bbc190 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:08.168870 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-09a46afe-cdf0-4f27-a671-0b8882bbc190 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 8ce564c8-7a17-4de1-96b9-3737fca73840] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:08.175191 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-09a46afe-cdf0-4f27-a671-0b8882bbc190 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:08.175670 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-09a46afe-cdf0-4f27-a671-0b8882bbc190 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:08.176102 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-09a46afe-cdf0-4f27-a671-0b8882bbc190 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:08.176812 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-09a46afe-cdf0-4f27-a671-0b8882bbc190 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:08.177291 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-09a46afe-cdf0-4f27-a671-0b8882bbc190 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:08.177709 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-09a46afe-cdf0-4f27-a671-0b8882bbc190 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:08.311858 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-09a46afe-cdf0-4f27-a671-0b8882bbc190 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:08.320122 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-09a46afe-cdf0-4f27-a671-0b8882bbc190 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840" status: 200 len: 1364 microversion: 2.1 time: 0.155800 Aug 31 01:23:08.320705 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 46/98] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:08 2022] GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:08.332894 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-d5b4051f-e7c6-4993-8455-211f8efd7fb2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:08.333507 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-d5b4051f-e7c6-4993-8455-211f8efd7fb2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:08.340027 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d5b4051f-e7c6-4993-8455-211f8efd7fb2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:08.340501 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d5b4051f-e7c6-4993-8455-211f8efd7fb2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:08.340976 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d5b4051f-e7c6-4993-8455-211f8efd7fb2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:08.341654 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d5b4051f-e7c6-4993-8455-211f8efd7fb2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:08.342103 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d5b4051f-e7c6-4993-8455-211f8efd7fb2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:08.342515 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d5b4051f-e7c6-4993-8455-211f8efd7fb2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:08.662865 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-d5b4051f-e7c6-4993-8455-211f8efd7fb2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:08.671448 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-d5b4051f-e7c6-4993-8455-211f8efd7fb2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 200 len: 1321 microversion: 2.1 time: 0.342635 Aug 31 01:23:08.672032 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 53/99] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:08 2022] GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 1321 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:08.906186 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-d46be53f-41f3-42b6-9cb6-1f70b007c7f2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:08.906828 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-d46be53f-41f3-42b6-9cb6-1f70b007c7f2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:08.912849 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d46be53f-41f3-42b6-9cb6-1f70b007c7f2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:08.913356 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d46be53f-41f3-42b6-9cb6-1f70b007c7f2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:08.913822 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d46be53f-41f3-42b6-9cb6-1f70b007c7f2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:08.914506 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d46be53f-41f3-42b6-9cb6-1f70b007c7f2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:08.914984 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d46be53f-41f3-42b6-9cb6-1f70b007c7f2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:08.915400 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d46be53f-41f3-42b6-9cb6-1f70b007c7f2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:09.118424 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-d46be53f-41f3-42b6-9cb6-1f70b007c7f2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:09.127260 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-d46be53f-41f3-42b6-9cb6-1f70b007c7f2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:09.129399 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-d46be53f-41f3-42b6-9cb6-1f70b007c7f2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:09.130593 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-d46be53f-41f3-42b6-9cb6-1f70b007c7f2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1408 microversion: 2.20 time: 0.228471 Aug 31 01:23:09.131737 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 47/100] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:23:08 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1408 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:23:09.342161 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-a031e2be-38ff-4516-b0be-70782d374e64 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:09.342875 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-a031e2be-38ff-4516-b0be-70782d374e64 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 8ce564c8-7a17-4de1-96b9-3737fca73840] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:09.350192 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a031e2be-38ff-4516-b0be-70782d374e64 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:09.350803 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a031e2be-38ff-4516-b0be-70782d374e64 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:09.351343 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a031e2be-38ff-4516-b0be-70782d374e64 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:09.352145 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a031e2be-38ff-4516-b0be-70782d374e64 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:09.352809 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a031e2be-38ff-4516-b0be-70782d374e64 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:09.353795 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a031e2be-38ff-4516-b0be-70782d374e64 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:09.618196 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-a031e2be-38ff-4516-b0be-70782d374e64 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:09.627823 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-a031e2be-38ff-4516-b0be-70782d374e64 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840" status: 200 len: 1364 microversion: 2.1 time: 0.290726 Aug 31 01:23:09.629167 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 54/101] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:09 2022] GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840 => generated 1364 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:09.691626 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-0bd3a49e-69fe-486d-859f-bd7a8f2acb45 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:09.692997 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-0bd3a49e-69fe-486d-859f-bd7a8f2acb45 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:09.702595 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0bd3a49e-69fe-486d-859f-bd7a8f2acb45 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:09.706290 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0bd3a49e-69fe-486d-859f-bd7a8f2acb45 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:09.707171 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0bd3a49e-69fe-486d-859f-bd7a8f2acb45 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:09.708104 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0bd3a49e-69fe-486d-859f-bd7a8f2acb45 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:09.708868 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0bd3a49e-69fe-486d-859f-bd7a8f2acb45 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:09.709175 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0bd3a49e-69fe-486d-859f-bd7a8f2acb45 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:09.970327 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-0bd3a49e-69fe-486d-859f-bd7a8f2acb45 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:09.976747 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-0bd3a49e-69fe-486d-859f-bd7a8f2acb45 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 200 len: 1516 microversion: 2.1 time: 0.289181 Aug 31 01:23:09.978306 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-eb1a9e8c-74f3-4d7e-a9aa-8460e4c4f2f7 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19555567-4d22-42ea-8830-a57376dbbd53"}} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:23:09.980860 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-eb1a9e8c-74f3-4d7e-a9aa-8460e4c4f2f7 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] [instance: 3f2e4287-f02a-4d2f-a669-621ae355fce5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:09.990170 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-eb1a9e8c-74f3-4d7e-a9aa-8460e4c4f2f7 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:09.991256 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-eb1a9e8c-74f3-4d7e-a9aa-8460e4c4f2f7 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:09.991761 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-eb1a9e8c-74f3-4d7e-a9aa-8460e4c4f2f7 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:09.992531 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-eb1a9e8c-74f3-4d7e-a9aa-8460e4c4f2f7 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:09.993336 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-eb1a9e8c-74f3-4d7e-a9aa-8460e4c4f2f7 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:09.993877 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-eb1a9e8c-74f3-4d7e-a9aa-8460e4c4f2f7 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:09.999558 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 48/102] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:09 2022] GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 1516 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:10.004882 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-b2766551-8c8f-4b7d-9879-ee7f0b969ef0 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:23:10.007779 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-b2766551-8c8f-4b7d-9879-ee7f0b969ef0 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:10.014201 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b2766551-8c8f-4b7d-9879-ee7f0b969ef0 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:10.014636 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b2766551-8c8f-4b7d-9879-ee7f0b969ef0 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:10.017913 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b2766551-8c8f-4b7d-9879-ee7f0b969ef0 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:10.017913 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b2766551-8c8f-4b7d-9879-ee7f0b969ef0 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:10.017913 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b2766551-8c8f-4b7d-9879-ee7f0b969ef0 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:10.017913 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b2766551-8c8f-4b7d-9879-ee7f0b969ef0 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:10.087216 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.objects.instance [None req-b2766551-8c8f-4b7d-9879-ee7f0b969ef0 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lazy-loading 'flavor' on Instance uuid bee91462-f582-40c7-88f9-652f75ce8b01 {{(pid=121025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:23:10.174345 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell1:SELECT=100 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:23:10.515484 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-b2766551-8c8f-4b7d-9879-ee7f0b969ef0 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "POST /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01/action" status: 200 len: 32 microversion: 2.1 time: 0.514608 Aug 31 01:23:10.516092 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 49/103] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 31 01:23:09 2022] POST /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01/action => generated 32 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 01:23:10.521196 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-655903c3-3107-442a-bdd3-653df185e405 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:10.522463 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-655903c3-3107-442a-bdd3-653df185e405 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:10.528509 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-655903c3-3107-442a-bdd3-653df185e405 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:10.529016 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-655903c3-3107-442a-bdd3-653df185e405 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:10.529472 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-655903c3-3107-442a-bdd3-653df185e405 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:10.530152 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-655903c3-3107-442a-bdd3-653df185e405 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:10.530596 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-655903c3-3107-442a-bdd3-653df185e405 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:10.531009 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-655903c3-3107-442a-bdd3-653df185e405 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:10.677197 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-655903c3-3107-442a-bdd3-653df185e405 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:10.689303 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-655903c3-3107-442a-bdd3-653df185e405 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:10.690713 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-655903c3-3107-442a-bdd3-653df185e405 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:10.692427 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-655903c3-3107-442a-bdd3-653df185e405 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1408 microversion: 2.20 time: 0.175174 Aug 31 01:23:10.693035 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 50/104] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:23:10 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:23:10.698908 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-6d05bea4-ce7f-4b13-be03-6aea8df3b1e2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:10.699648 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-6d05bea4-ce7f-4b13-be03-6aea8df3b1e2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:10.726498 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6d05bea4-ce7f-4b13-be03-6aea8df3b1e2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:10.726498 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6d05bea4-ce7f-4b13-be03-6aea8df3b1e2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:10.726498 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6d05bea4-ce7f-4b13-be03-6aea8df3b1e2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:10.737486 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6d05bea4-ce7f-4b13-be03-6aea8df3b1e2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:10.738135 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6d05bea4-ce7f-4b13-be03-6aea8df3b1e2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:10.738722 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6d05bea4-ce7f-4b13-be03-6aea8df3b1e2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:10.923806 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-6d05bea4-ce7f-4b13-be03-6aea8df3b1e2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:10.941816 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-6d05bea4-ce7f-4b13-be03-6aea8df3b1e2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 200 len: 1522 microversion: 2.1 time: 0.247073 Aug 31 01:23:10.942952 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 51/105] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:10 2022] GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:10.948748 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-04c5ca22-6c36-4dab-a1e3-706dfad18ad0 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:10.949660 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-04c5ca22-6c36-4dab-a1e3-706dfad18ad0 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 8ce564c8-7a17-4de1-96b9-3737fca73840] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:10.956397 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-04c5ca22-6c36-4dab-a1e3-706dfad18ad0 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:10.957279 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-04c5ca22-6c36-4dab-a1e3-706dfad18ad0 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:10.957860 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-04c5ca22-6c36-4dab-a1e3-706dfad18ad0 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:10.959040 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-04c5ca22-6c36-4dab-a1e3-706dfad18ad0 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:10.960016 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-04c5ca22-6c36-4dab-a1e3-706dfad18ad0 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:10.960984 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-04c5ca22-6c36-4dab-a1e3-706dfad18ad0 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:11.174782 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-04c5ca22-6c36-4dab-a1e3-706dfad18ad0 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:11.185242 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-04c5ca22-6c36-4dab-a1e3-706dfad18ad0 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840" status: 200 len: 1364 microversion: 2.1 time: 0.240531 Aug 31 01:23:11.186130 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 52/106] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:10 2022] GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840 => generated 1364 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:11.719464 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-e27d12af-fc5a-42d4-81e0-eab73b54722f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:11.720343 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-e27d12af-fc5a-42d4-81e0-eab73b54722f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:11.727722 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e27d12af-fc5a-42d4-81e0-eab73b54722f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:11.728205 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e27d12af-fc5a-42d4-81e0-eab73b54722f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:11.728642 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e27d12af-fc5a-42d4-81e0-eab73b54722f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:11.729394 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e27d12af-fc5a-42d4-81e0-eab73b54722f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:11.729847 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e27d12af-fc5a-42d4-81e0-eab73b54722f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:11.730269 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e27d12af-fc5a-42d4-81e0-eab73b54722f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:11.867513 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-e27d12af-fc5a-42d4-81e0-eab73b54722f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:11.875746 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-e27d12af-fc5a-42d4-81e0-eab73b54722f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:11.877198 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-e27d12af-fc5a-42d4-81e0-eab73b54722f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:11.878408 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-e27d12af-fc5a-42d4-81e0-eab73b54722f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1408 microversion: 2.20 time: 0.163336 Aug 31 01:23:11.878974 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 53/107] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:23:11 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 01:23:11.901160 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-eb1a9e8c-74f3-4d7e-a9aa-8460e4c4f2f7 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] 10.222.0.20 "POST /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.928460 Aug 31 01:23:11.906934 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 55/108] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 31 01:23:09 2022] POST /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5/os-volume_attachments => generated 194 bytes in 1931 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:23:11.973487 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-7aa3f7cd-0e17-45ae-bb56-f3edb1dd6dc5 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:11.974095 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-7aa3f7cd-0e17-45ae-bb56-f3edb1dd6dc5 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:11.980548 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [req-d6e55b70-70c2-4acd-8e3d-44cefb88aadb req-fe56d9f5-47df-4c81-9e81-7c1596e5f81a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ce564c8-7a17-4de1-96b9-3737fca73840", "name": "network-vif-plugged", "status": "completed", "tag": "06a28bab-3d45-4348-850c-bb3c714f41df"}]} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:23:11.981611 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7aa3f7cd-0e17-45ae-bb56-f3edb1dd6dc5 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:11.982245 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7aa3f7cd-0e17-45ae-bb56-f3edb1dd6dc5 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:11.982894 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7aa3f7cd-0e17-45ae-bb56-f3edb1dd6dc5 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:11.983744 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7aa3f7cd-0e17-45ae-bb56-f3edb1dd6dc5 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:11.984410 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7aa3f7cd-0e17-45ae-bb56-f3edb1dd6dc5 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:11.985030 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7aa3f7cd-0e17-45ae-bb56-f3edb1dd6dc5 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:11.992579 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-d6e55b70-70c2-4acd-8e3d-44cefb88aadb req-fe56d9f5-47df-4c81-9e81-7c1596e5f81a service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:11.993210 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-d6e55b70-70c2-4acd-8e3d-44cefb88aadb req-fe56d9f5-47df-4c81-9e81-7c1596e5f81a service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:11.995201 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-d6e55b70-70c2-4acd-8e3d-44cefb88aadb req-fe56d9f5-47df-4c81-9e81-7c1596e5f81a service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:12.010161 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.compute.server_external_events [req-d6e55b70-70c2-4acd-8e3d-44cefb88aadb req-fe56d9f5-47df-4c81-9e81-7c1596e5f81a service nova] Creating event network-vif-plugged:06a28bab-3d45-4348-850c-bb3c714f41df for instance 8ce564c8-7a17-4de1-96b9-3737fca73840 on hv-cinder-85528 Aug 31 01:23:12.015462 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [req-d6e55b70-70c2-4acd-8e3d-44cefb88aadb req-fe56d9f5-47df-4c81-9e81-7c1596e5f81a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039300 Aug 31 01:23:12.017646 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 56/109] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:23:12.177933 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-7aa3f7cd-0e17-45ae-bb56-f3edb1dd6dc5 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:12.185901 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-7aa3f7cd-0e17-45ae-bb56-f3edb1dd6dc5 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 200 len: 1522 microversion: 2.1 time: 0.224149 Aug 31 01:23:12.186466 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 54/110] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:11 2022] GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:12.207394 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-ea36c3fa-6b9e-4472-aef9-420565776655 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:12.208067 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-ea36c3fa-6b9e-4472-aef9-420565776655 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 8ce564c8-7a17-4de1-96b9-3737fca73840] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:12.214744 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ea36c3fa-6b9e-4472-aef9-420565776655 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:12.215217 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ea36c3fa-6b9e-4472-aef9-420565776655 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:12.215641 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ea36c3fa-6b9e-4472-aef9-420565776655 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:12.216317 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ea36c3fa-6b9e-4472-aef9-420565776655 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:12.216785 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ea36c3fa-6b9e-4472-aef9-420565776655 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:12.217346 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ea36c3fa-6b9e-4472-aef9-420565776655 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:12.369568 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-ea36c3fa-6b9e-4472-aef9-420565776655 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:12.377740 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-ea36c3fa-6b9e-4472-aef9-420565776655 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840" status: 200 len: 1364 microversion: 2.1 time: 0.175148 Aug 31 01:23:12.378308 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 57/111] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:12 2022] GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840 => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:12.901131 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-05f2e736-29c8-4893-8fb3-53bc2567d106 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:12.901730 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-05f2e736-29c8-4893-8fb3-53bc2567d106 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:12.907638 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-05f2e736-29c8-4893-8fb3-53bc2567d106 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:12.908108 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-05f2e736-29c8-4893-8fb3-53bc2567d106 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:12.908528 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-05f2e736-29c8-4893-8fb3-53bc2567d106 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:12.909231 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-05f2e736-29c8-4893-8fb3-53bc2567d106 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:12.909674 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-05f2e736-29c8-4893-8fb3-53bc2567d106 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:12.910091 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-05f2e736-29c8-4893-8fb3-53bc2567d106 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:13.080425 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-05f2e736-29c8-4893-8fb3-53bc2567d106 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:13.089285 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-05f2e736-29c8-4893-8fb3-53bc2567d106 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:13.091411 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-05f2e736-29c8-4893-8fb3-53bc2567d106 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:13.093129 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-05f2e736-29c8-4893-8fb3-53bc2567d106 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1408 microversion: 2.20 time: 0.195798 Aug 31 01:23:13.105289 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 55/112] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:23:12 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1408 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:23:13.211310 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-c6554c99-115f-4b9a-87cb-170d28eb4f7e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:13.211964 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-c6554c99-115f-4b9a-87cb-170d28eb4f7e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:13.221139 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c6554c99-115f-4b9a-87cb-170d28eb4f7e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:13.221776 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c6554c99-115f-4b9a-87cb-170d28eb4f7e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:13.222427 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c6554c99-115f-4b9a-87cb-170d28eb4f7e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:13.223272 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c6554c99-115f-4b9a-87cb-170d28eb4f7e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:13.223870 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c6554c99-115f-4b9a-87cb-170d28eb4f7e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:13.225513 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c6554c99-115f-4b9a-87cb-170d28eb4f7e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:13.354564 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-c6554c99-115f-4b9a-87cb-170d28eb4f7e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:13.362734 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-c6554c99-115f-4b9a-87cb-170d28eb4f7e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 200 len: 1522 microversion: 2.1 time: 0.159099 Aug 31 01:23:13.363299 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 58/113] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:13 2022] GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:13.399850 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-9d238450-c349-4e02-aafa-b8921828c4ab tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:13.402840 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-9d238450-c349-4e02-aafa-b8921828c4ab tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 8ce564c8-7a17-4de1-96b9-3737fca73840] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:13.406519 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9d238450-c349-4e02-aafa-b8921828c4ab tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:13.406992 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9d238450-c349-4e02-aafa-b8921828c4ab tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:13.407461 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9d238450-c349-4e02-aafa-b8921828c4ab tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:13.408333 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9d238450-c349-4e02-aafa-b8921828c4ab tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:13.408801 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9d238450-c349-4e02-aafa-b8921828c4ab tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:13.409217 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9d238450-c349-4e02-aafa-b8921828c4ab tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:13.544032 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-9d238450-c349-4e02-aafa-b8921828c4ab tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:13.551875 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-9d238450-c349-4e02-aafa-b8921828c4ab tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840" status: 200 len: 1364 microversion: 2.1 time: 0.156422 Aug 31 01:23:13.557916 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 56/114] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:13 2022] GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:14.118208 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-0b2383a8-21f0-42c1-b735-d0fa1e3ca46a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:14.119167 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-0b2383a8-21f0-42c1-b735-d0fa1e3ca46a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:14.126785 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0b2383a8-21f0-42c1-b735-d0fa1e3ca46a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:14.127471 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0b2383a8-21f0-42c1-b735-d0fa1e3ca46a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:14.128122 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0b2383a8-21f0-42c1-b735-d0fa1e3ca46a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:14.131169 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0b2383a8-21f0-42c1-b735-d0fa1e3ca46a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:14.131169 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0b2383a8-21f0-42c1-b735-d0fa1e3ca46a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:14.131169 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0b2383a8-21f0-42c1-b735-d0fa1e3ca46a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:14.369340 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-0b2383a8-21f0-42c1-b735-d0fa1e3ca46a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:14.382436 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-0b2383a8-21f0-42c1-b735-d0fa1e3ca46a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:14.385923 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-9b959912-3964-43e8-9888-dcee5f97d317 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:14.386418 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-0b2383a8-21f0-42c1-b735-d0fa1e3ca46a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:14.386570 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-9b959912-3964-43e8-9888-dcee5f97d317 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:14.391094 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-0b2383a8-21f0-42c1-b735-d0fa1e3ca46a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1408 microversion: 2.20 time: 0.277669 Aug 31 01:23:14.391882 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 59/115] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:23:14 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1408 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:23:14.395583 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9b959912-3964-43e8-9888-dcee5f97d317 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:14.396117 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9b959912-3964-43e8-9888-dcee5f97d317 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:14.396519 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9b959912-3964-43e8-9888-dcee5f97d317 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:14.397237 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9b959912-3964-43e8-9888-dcee5f97d317 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:14.397682 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9b959912-3964-43e8-9888-dcee5f97d317 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:14.398097 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9b959912-3964-43e8-9888-dcee5f97d317 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:14.569390 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-9b959912-3964-43e8-9888-dcee5f97d317 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:14.578838 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-9b959912-3964-43e8-9888-dcee5f97d317 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 200 len: 1522 microversion: 2.1 time: 0.199195 Aug 31 01:23:14.579385 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-c8bd370f-9ec3-471c-9605-cda759506a2b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:14.580321 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 57/116] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:14 2022] GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:23:14.588739 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-c8bd370f-9ec3-471c-9605-cda759506a2b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 8ce564c8-7a17-4de1-96b9-3737fca73840] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:14.601612 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c8bd370f-9ec3-471c-9605-cda759506a2b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:14.602095 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c8bd370f-9ec3-471c-9605-cda759506a2b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:14.602578 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c8bd370f-9ec3-471c-9605-cda759506a2b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:14.603462 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c8bd370f-9ec3-471c-9605-cda759506a2b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:14.603908 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c8bd370f-9ec3-471c-9605-cda759506a2b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:14.604319 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c8bd370f-9ec3-471c-9605-cda759506a2b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:14.766644 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-c8bd370f-9ec3-471c-9605-cda759506a2b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:14.775923 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-c8bd370f-9ec3-471c-9605-cda759506a2b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840" status: 200 len: 1364 microversion: 2.1 time: 0.202140 Aug 31 01:23:14.776493 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 60/117] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:14 2022] GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840 => generated 1364 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:15.415880 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-867aebdc-7a20-4c56-bc68-95d24efca2a4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:15.416592 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-867aebdc-7a20-4c56-bc68-95d24efca2a4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:15.422897 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-867aebdc-7a20-4c56-bc68-95d24efca2a4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:15.423538 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-867aebdc-7a20-4c56-bc68-95d24efca2a4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:15.423965 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-867aebdc-7a20-4c56-bc68-95d24efca2a4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:15.424643 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-867aebdc-7a20-4c56-bc68-95d24efca2a4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:15.425113 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-867aebdc-7a20-4c56-bc68-95d24efca2a4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:15.425525 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-867aebdc-7a20-4c56-bc68-95d24efca2a4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:15.575622 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-867aebdc-7a20-4c56-bc68-95d24efca2a4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:15.584419 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-867aebdc-7a20-4c56-bc68-95d24efca2a4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:15.586329 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-867aebdc-7a20-4c56-bc68-95d24efca2a4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:15.587451 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-867aebdc-7a20-4c56-bc68-95d24efca2a4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1408 microversion: 2.20 time: 0.176155 Aug 31 01:23:15.588001 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 58/118] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:23:15 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1408 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:23:15.614185 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-98596e94-55cf-46e3-b308-80910d1d6f82 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:15.614185 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-98596e94-55cf-46e3-b308-80910d1d6f82 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:15.619492 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-98596e94-55cf-46e3-b308-80910d1d6f82 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:15.620446 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-98596e94-55cf-46e3-b308-80910d1d6f82 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:15.621378 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-98596e94-55cf-46e3-b308-80910d1d6f82 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:15.622645 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-98596e94-55cf-46e3-b308-80910d1d6f82 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:15.623266 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-98596e94-55cf-46e3-b308-80910d1d6f82 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:15.624106 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-98596e94-55cf-46e3-b308-80910d1d6f82 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:15.658231 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:23:15.808897 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-1c89c73b-bd02-4324-b847-59337ffbc7ce tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:15.810408 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-1c89c73b-bd02-4324-b847-59337ffbc7ce tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 8ce564c8-7a17-4de1-96b9-3737fca73840] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:15.822669 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-98596e94-55cf-46e3-b308-80910d1d6f82 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:15.823416 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1c89c73b-bd02-4324-b847-59337ffbc7ce tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:15.826359 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1c89c73b-bd02-4324-b847-59337ffbc7ce tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:15.826980 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1c89c73b-bd02-4324-b847-59337ffbc7ce tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:15.829550 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1c89c73b-bd02-4324-b847-59337ffbc7ce tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:15.829550 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1c89c73b-bd02-4324-b847-59337ffbc7ce tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:15.829550 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1c89c73b-bd02-4324-b847-59337ffbc7ce tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:15.841028 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-98596e94-55cf-46e3-b308-80910d1d6f82 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 200 len: 1522 microversion: 2.1 time: 0.241171 Aug 31 01:23:15.841969 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 61/119] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:15 2022] GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:15.983469 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [req-8716e7f8-e564-417a-bb46-02892c080712 req-4ceef162-2641-4162-b831-4d8a35655f9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12814f73-696a-4dc2-9182-7779bfe90ad5", "name": "network-vif-plugged", "status": "completed", "tag": "dc60a507-f9d6-4b68-ae6c-65c2cfafb12c"}]} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:23:16.005036 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-8716e7f8-e564-417a-bb46-02892c080712 req-4ceef162-2641-4162-b831-4d8a35655f9a service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:16.005496 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-8716e7f8-e564-417a-bb46-02892c080712 req-4ceef162-2641-4162-b831-4d8a35655f9a service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:16.013221 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-8716e7f8-e564-417a-bb46-02892c080712 req-4ceef162-2641-4162-b831-4d8a35655f9a service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:16.040021 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.compute.server_external_events [req-8716e7f8-e564-417a-bb46-02892c080712 req-4ceef162-2641-4162-b831-4d8a35655f9a service nova] Creating event network-vif-plugged:dc60a507-f9d6-4b68-ae6c-65c2cfafb12c for instance 12814f73-696a-4dc2-9182-7779bfe90ad5 on hv-cinder-85528 Aug 31 01:23:16.053026 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [req-8716e7f8-e564-417a-bb46-02892c080712 req-4ceef162-2641-4162-b831-4d8a35655f9a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072816 Aug 31 01:23:16.056050 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 62/120] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:23:16.079322 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-1c89c73b-bd02-4324-b847-59337ffbc7ce tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:16.089362 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-1c89c73b-bd02-4324-b847-59337ffbc7ce tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840" status: 200 len: 1553 microversion: 2.1 time: 0.294665 Aug 31 01:23:16.090790 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 59/121] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:15 2022] GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840 => generated 1553 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:16.118178 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-3994fcff-279c-40a0-84b8-b439c4c32877 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:16.118750 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-3994fcff-279c-40a0-84b8-b439c4c32877 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 8ce564c8-7a17-4de1-96b9-3737fca73840] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:16.125254 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3994fcff-279c-40a0-84b8-b439c4c32877 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:16.125735 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3994fcff-279c-40a0-84b8-b439c4c32877 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:16.126161 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3994fcff-279c-40a0-84b8-b439c4c32877 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:16.126846 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3994fcff-279c-40a0-84b8-b439c4c32877 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:16.127328 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3994fcff-279c-40a0-84b8-b439c4c32877 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:16.127751 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3994fcff-279c-40a0-84b8-b439c4c32877 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:16.264300 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-3994fcff-279c-40a0-84b8-b439c4c32877 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.150290 Aug 31 01:23:16.268633 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 63/122] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Aug 31 01:23:16 2022] GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840/os-interface => generated 284 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:23:16.623127 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-f15779aa-2860-4932-926e-369f8bb011d5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:16.624446 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-f15779aa-2860-4932-926e-369f8bb011d5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:16.641871 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f15779aa-2860-4932-926e-369f8bb011d5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:16.644099 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f15779aa-2860-4932-926e-369f8bb011d5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:16.645424 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f15779aa-2860-4932-926e-369f8bb011d5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:16.648408 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f15779aa-2860-4932-926e-369f8bb011d5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:16.649829 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f15779aa-2860-4932-926e-369f8bb011d5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:16.651564 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f15779aa-2860-4932-926e-369f8bb011d5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:16.820039 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-f15779aa-2860-4932-926e-369f8bb011d5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:16.828419 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-f15779aa-2860-4932-926e-369f8bb011d5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:16.830345 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-f15779aa-2860-4932-926e-369f8bb011d5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:16.831646 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-f15779aa-2860-4932-926e-369f8bb011d5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1408 microversion: 2.20 time: 0.212467 Aug 31 01:23:16.832213 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 60/123] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:23:16 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1408 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:23:16.863597 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-ff7d0971-86db-4cac-9776-41e8da8115f9 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:16.865257 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-ff7d0971-86db-4cac-9776-41e8da8115f9 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:16.881100 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ff7d0971-86db-4cac-9776-41e8da8115f9 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:16.883782 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ff7d0971-86db-4cac-9776-41e8da8115f9 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:16.885640 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ff7d0971-86db-4cac-9776-41e8da8115f9 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:16.887962 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ff7d0971-86db-4cac-9776-41e8da8115f9 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:16.888616 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ff7d0971-86db-4cac-9776-41e8da8115f9 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:16.892275 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ff7d0971-86db-4cac-9776-41e8da8115f9 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:17.084227 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-ff7d0971-86db-4cac-9776-41e8da8115f9 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:17.091917 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-ff7d0971-86db-4cac-9776-41e8da8115f9 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 200 len: 1522 microversion: 2.1 time: 0.233390 Aug 31 01:23:17.092488 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 64/124] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:16 2022] GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:17.854955 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-b97d7c97-2da0-47ff-ae2d-b93ba9fde2be tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:17.856136 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-b97d7c97-2da0-47ff-ae2d-b93ba9fde2be tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:17.859366 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:23:17.863185 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b97d7c97-2da0-47ff-ae2d-b93ba9fde2be tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:17.863882 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b97d7c97-2da0-47ff-ae2d-b93ba9fde2be tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:17.864377 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b97d7c97-2da0-47ff-ae2d-b93ba9fde2be tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:17.865287 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b97d7c97-2da0-47ff-ae2d-b93ba9fde2be tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:17.865738 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b97d7c97-2da0-47ff-ae2d-b93ba9fde2be tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:17.866314 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b97d7c97-2da0-47ff-ae2d-b93ba9fde2be tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:18.043575 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-b97d7c97-2da0-47ff-ae2d-b93ba9fde2be tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:18.053093 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-b97d7c97-2da0-47ff-ae2d-b93ba9fde2be tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:18.054552 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-b97d7c97-2da0-47ff-ae2d-b93ba9fde2be tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:18.055726 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-b97d7c97-2da0-47ff-ae2d-b93ba9fde2be tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1408 microversion: 2.20 time: 0.204659 Aug 31 01:23:18.056446 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 61/125] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:23:17 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1408 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:23:18.113656 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-fd4c0572-8d4e-40cd-9461-08050f14e1c2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:18.114268 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-fd4c0572-8d4e-40cd-9461-08050f14e1c2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:18.126820 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fd4c0572-8d4e-40cd-9461-08050f14e1c2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:18.132107 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fd4c0572-8d4e-40cd-9461-08050f14e1c2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:18.135201 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-206e82ec-a40a-4921-9ba0-f409bdaab9fa req-842d06f4-038b-48a2-a0ed-76192b7d17b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ce564c8-7a17-4de1-96b9-3737fca73840", "tag": "06a28bab-3d45-4348-850c-bb3c714f41df"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:23:18.140000 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fd4c0572-8d4e-40cd-9461-08050f14e1c2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:18.140807 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fd4c0572-8d4e-40cd-9461-08050f14e1c2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:18.141266 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fd4c0572-8d4e-40cd-9461-08050f14e1c2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:18.141690 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fd4c0572-8d4e-40cd-9461-08050f14e1c2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:18.162572 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-206e82ec-a40a-4921-9ba0-f409bdaab9fa req-842d06f4-038b-48a2-a0ed-76192b7d17b0 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:18.163093 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-206e82ec-a40a-4921-9ba0-f409bdaab9fa req-842d06f4-038b-48a2-a0ed-76192b7d17b0 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:18.164850 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-206e82ec-a40a-4921-9ba0-f409bdaab9fa req-842d06f4-038b-48a2-a0ed-76192b7d17b0 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:18.206522 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-206e82ec-a40a-4921-9ba0-f409bdaab9fa req-842d06f4-038b-48a2-a0ed-76192b7d17b0 service nova] Creating event network-changed:06a28bab-3d45-4348-850c-bb3c714f41df for instance 8ce564c8-7a17-4de1-96b9-3737fca73840 on hv-cinder-85528 Aug 31 01:23:18.213549 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-206e82ec-a40a-4921-9ba0-f409bdaab9fa req-842d06f4-038b-48a2-a0ed-76192b7d17b0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081888 Aug 31 01:23:18.214830 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 62/126] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:23:18.437332 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-fd4c0572-8d4e-40cd-9461-08050f14e1c2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:18.437332 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-fd4c0572-8d4e-40cd-9461-08050f14e1c2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 200 len: 1522 microversion: 2.1 time: 0.322982 Aug 31 01:23:18.437332 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 65/127] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:18 2022] GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:19.082441 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-7728ca6b-a3b6-4b1f-b8d3-e0014b5dbe63 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:19.083863 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-7728ca6b-a3b6-4b1f-b8d3-e0014b5dbe63 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:19.092833 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7728ca6b-a3b6-4b1f-b8d3-e0014b5dbe63 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:19.094296 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7728ca6b-a3b6-4b1f-b8d3-e0014b5dbe63 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:19.094906 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7728ca6b-a3b6-4b1f-b8d3-e0014b5dbe63 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:19.095884 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7728ca6b-a3b6-4b1f-b8d3-e0014b5dbe63 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:19.096545 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7728ca6b-a3b6-4b1f-b8d3-e0014b5dbe63 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:19.097281 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7728ca6b-a3b6-4b1f-b8d3-e0014b5dbe63 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:19.264964 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-7728ca6b-a3b6-4b1f-b8d3-e0014b5dbe63 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:19.282407 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-7728ca6b-a3b6-4b1f-b8d3-e0014b5dbe63 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:19.296518 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-7728ca6b-a3b6-4b1f-b8d3-e0014b5dbe63 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:19.299736 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-7728ca6b-a3b6-4b1f-b8d3-e0014b5dbe63 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1601 microversion: 2.20 time: 0.222337 Aug 31 01:23:19.300471 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 63/128] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:23:19 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1601 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:23:19.332526 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-8e67f368-e128-4525-b960-df630e7dace0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:19.333982 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-8e67f368-e128-4525-b960-df630e7dace0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:19.342649 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8e67f368-e128-4525-b960-df630e7dace0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:19.343618 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8e67f368-e128-4525-b960-df630e7dace0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:19.344162 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8e67f368-e128-4525-b960-df630e7dace0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:19.345180 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8e67f368-e128-4525-b960-df630e7dace0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:19.345885 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8e67f368-e128-4525-b960-df630e7dace0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:19.346390 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8e67f368-e128-4525-b960-df630e7dace0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:19.453474 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-4c272697-0474-4c2c-8fce-67633e576e9a tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:19.454743 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-4c272697-0474-4c2c-8fce-67633e576e9a tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:19.460542 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-8e67f368-e128-4525-b960-df630e7dace0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.136615 Aug 31 01:23:19.461516 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 66/129] 10.222.0.20 () {60 vars in 1316 bytes} [Wed Aug 31 01:23:19 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5/os-interface => generated 285 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 01:23:19.464886 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4c272697-0474-4c2c-8fce-67633e576e9a tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:19.464886 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4c272697-0474-4c2c-8fce-67633e576e9a tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:19.464886 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4c272697-0474-4c2c-8fce-67633e576e9a tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:19.465138 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4c272697-0474-4c2c-8fce-67633e576e9a tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:19.466960 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4c272697-0474-4c2c-8fce-67633e576e9a tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:19.467595 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4c272697-0474-4c2c-8fce-67633e576e9a tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:19.722581 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-4c272697-0474-4c2c-8fce-67633e576e9a tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:19.737401 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-4c272697-0474-4c2c-8fce-67633e576e9a tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 200 len: 1522 microversion: 2.1 time: 0.287598 Aug 31 01:23:19.738001 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 64/130] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:19 2022] GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:20.758914 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-003dce09-c293-412c-8af7-29c7beda24ff tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:20.759499 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-003dce09-c293-412c-8af7-29c7beda24ff tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:20.777537 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-003dce09-c293-412c-8af7-29c7beda24ff tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:20.778277 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-003dce09-c293-412c-8af7-29c7beda24ff tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:20.778862 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-003dce09-c293-412c-8af7-29c7beda24ff tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:20.779715 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-003dce09-c293-412c-8af7-29c7beda24ff tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:20.780307 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-003dce09-c293-412c-8af7-29c7beda24ff tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:20.780904 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-003dce09-c293-412c-8af7-29c7beda24ff tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:20.945930 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-a6a54ffd-71d5-4090-812a-edeb5b2c342d req-ff9d692a-a27e-43c9-ac95-304e40444a04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12814f73-696a-4dc2-9182-7779bfe90ad5", "tag": "dc60a507-f9d6-4b68-ae6c-65c2cfafb12c"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:23:20.960024 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-a6a54ffd-71d5-4090-812a-edeb5b2c342d req-ff9d692a-a27e-43c9-ac95-304e40444a04 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:20.960654 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-a6a54ffd-71d5-4090-812a-edeb5b2c342d req-ff9d692a-a27e-43c9-ac95-304e40444a04 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:20.962078 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-a6a54ffd-71d5-4090-812a-edeb5b2c342d req-ff9d692a-a27e-43c9-ac95-304e40444a04 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:20.982178 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-a6a54ffd-71d5-4090-812a-edeb5b2c342d req-ff9d692a-a27e-43c9-ac95-304e40444a04 service nova] Creating event network-changed:dc60a507-f9d6-4b68-ae6c-65c2cfafb12c for instance 12814f73-696a-4dc2-9182-7779bfe90ad5 on hv-cinder-85528 Aug 31 01:23:20.988711 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-a6a54ffd-71d5-4090-812a-edeb5b2c342d req-ff9d692a-a27e-43c9-ac95-304e40444a04 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049240 Aug 31 01:23:20.989874 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 65/131] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:23:20.992787 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-003dce09-c293-412c-8af7-29c7beda24ff tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:21.001442 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-003dce09-c293-412c-8af7-29c7beda24ff tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 200 len: 1522 microversion: 2.1 time: 0.246803 Aug 31 01:23:21.002052 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 67/132] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:20 2022] GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:21.998860 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-1a3abf21-944f-44ce-acd0-cb109b7126a5 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:21.999464 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-1a3abf21-944f-44ce-acd0-cb109b7126a5 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] [instance: 3f2e4287-f02a-4d2f-a669-621ae355fce5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:22.011719 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1a3abf21-944f-44ce-acd0-cb109b7126a5 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:22.012271 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1a3abf21-944f-44ce-acd0-cb109b7126a5 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:22.012764 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1a3abf21-944f-44ce-acd0-cb109b7126a5 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:22.013467 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1a3abf21-944f-44ce-acd0-cb109b7126a5 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:22.013924 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1a3abf21-944f-44ce-acd0-cb109b7126a5 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:22.014342 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1a3abf21-944f-44ce-acd0-cb109b7126a5 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:22.026098 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-0cef801e-4176-4e29-a7eb-963d11707b24 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:22.027382 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-0cef801e-4176-4e29-a7eb-963d11707b24 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:22.042452 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0cef801e-4176-4e29-a7eb-963d11707b24 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:22.042985 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0cef801e-4176-4e29-a7eb-963d11707b24 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:22.043623 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0cef801e-4176-4e29-a7eb-963d11707b24 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:22.044492 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0cef801e-4176-4e29-a7eb-963d11707b24 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:22.045662 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:23:22.046323 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0cef801e-4176-4e29-a7eb-963d11707b24 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:22.046914 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0cef801e-4176-4e29-a7eb-963d11707b24 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:22.057110 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-1a3abf21-944f-44ce-acd0-cb109b7126a5 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] [instance: 3f2e4287-f02a-4d2f-a669-621ae355fce5] Going to try to terminate instance {{(pid=121025) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 01:23:22.364100 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-0cef801e-4176-4e29-a7eb-963d11707b24 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:22.375810 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-0cef801e-4176-4e29-a7eb-963d11707b24 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 200 len: 1522 microversion: 2.1 time: 0.356702 Aug 31 01:23:22.377373 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 68/133] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:22 2022] GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 1522 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:22.504654 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-1a3abf21-944f-44ce-acd0-cb109b7126a5 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5" status: 204 len: 0 microversion: 2.1 time: 0.514767 Aug 31 01:23:22.507134 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 66/134] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 01:23:21 2022] DELETE /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 01:23:22.511645 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-1b8c3130-bffa-4ab5-afad-d94443ba584d tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:22.512435 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-1b8c3130-bffa-4ab5-afad-d94443ba584d tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] [instance: 3f2e4287-f02a-4d2f-a669-621ae355fce5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:22.523691 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1b8c3130-bffa-4ab5-afad-d94443ba584d tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:22.524322 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1b8c3130-bffa-4ab5-afad-d94443ba584d tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:22.525014 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1b8c3130-bffa-4ab5-afad-d94443ba584d tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:22.526120 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1b8c3130-bffa-4ab5-afad-d94443ba584d tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:22.526727 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1b8c3130-bffa-4ab5-afad-d94443ba584d tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:22.528693 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1b8c3130-bffa-4ab5-afad-d94443ba584d tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:22.667967 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-1b8c3130-bffa-4ab5-afad-d94443ba584d tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d058c2b40343a6a3e2e46f6b2bab0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb95e8d0a84b76a5d141815451ceae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:22.676227 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-1b8c3130-bffa-4ab5-afad-d94443ba584d tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] 10.222.0.20 "GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5" status: 200 len: 1552 microversion: 2.1 time: 0.168497 Aug 31 01:23:22.676817 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 69/135] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:22 2022] GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5 => generated 1552 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:23:23.406401 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-a68f0022-2eb1-47a5-987b-a360acfbfb5f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:23.407147 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-a68f0022-2eb1-47a5-987b-a360acfbfb5f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:23.413900 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a68f0022-2eb1-47a5-987b-a360acfbfb5f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:23.414372 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a68f0022-2eb1-47a5-987b-a360acfbfb5f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:23.414881 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a68f0022-2eb1-47a5-987b-a360acfbfb5f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:23.415596 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a68f0022-2eb1-47a5-987b-a360acfbfb5f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:23.416036 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a68f0022-2eb1-47a5-987b-a360acfbfb5f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:23.416443 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a68f0022-2eb1-47a5-987b-a360acfbfb5f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:23.595876 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-a68f0022-2eb1-47a5-987b-a360acfbfb5f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:23.605898 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-a68f0022-2eb1-47a5-987b-a360acfbfb5f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 200 len: 1522 microversion: 2.1 time: 0.203696 Aug 31 01:23:23.607787 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 67/136] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:23 2022] GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:23.699474 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-fc867525-e18b-4398-80b1-8a15ab4d4301 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:23.700945 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-fc867525-e18b-4398-80b1-8a15ab4d4301 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] [instance: 3f2e4287-f02a-4d2f-a669-621ae355fce5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:23.705178 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:23:23.709568 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fc867525-e18b-4398-80b1-8a15ab4d4301 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:23.710430 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fc867525-e18b-4398-80b1-8a15ab4d4301 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:23.711059 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fc867525-e18b-4398-80b1-8a15ab4d4301 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:23.711762 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fc867525-e18b-4398-80b1-8a15ab4d4301 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:23.712398 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fc867525-e18b-4398-80b1-8a15ab4d4301 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:23.712851 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fc867525-e18b-4398-80b1-8a15ab4d4301 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:23.861309 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-fc867525-e18b-4398-80b1-8a15ab4d4301 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d058c2b40343a6a3e2e46f6b2bab0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb95e8d0a84b76a5d141815451ceae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:23.870802 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-fc867525-e18b-4398-80b1-8a15ab4d4301 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] 10.222.0.20 "GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5" status: 200 len: 1552 microversion: 2.1 time: 0.175278 Aug 31 01:23:23.871398 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 70/137] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:23 2022] GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5 => generated 1552 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:24.639552 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-08397860-b1fa-47a6-88bf-658743ac3586 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:24.640273 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-08397860-b1fa-47a6-88bf-658743ac3586 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:24.647343 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-08397860-b1fa-47a6-88bf-658743ac3586 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:24.647844 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-08397860-b1fa-47a6-88bf-658743ac3586 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:24.648297 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-08397860-b1fa-47a6-88bf-658743ac3586 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:24.648999 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-08397860-b1fa-47a6-88bf-658743ac3586 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:24.649434 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-08397860-b1fa-47a6-88bf-658743ac3586 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:24.650214 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-08397860-b1fa-47a6-88bf-658743ac3586 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:24.850408 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-08397860-b1fa-47a6-88bf-658743ac3586 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:24.857948 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-08397860-b1fa-47a6-88bf-658743ac3586 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 200 len: 1522 microversion: 2.1 time: 0.223880 Aug 31 01:23:24.858508 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 68/138] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:24 2022] GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:24.892479 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-89d55af7-b669-4811-a124-534f601dcc74 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:24.893227 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-89d55af7-b669-4811-a124-534f601dcc74 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] [instance: 3f2e4287-f02a-4d2f-a669-621ae355fce5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:24.901252 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-89d55af7-b669-4811-a124-534f601dcc74 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:24.901252 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-89d55af7-b669-4811-a124-534f601dcc74 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:24.901696 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-89d55af7-b669-4811-a124-534f601dcc74 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:24.902404 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-89d55af7-b669-4811-a124-534f601dcc74 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:24.902857 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-89d55af7-b669-4811-a124-534f601dcc74 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:24.903320 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-89d55af7-b669-4811-a124-534f601dcc74 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:25.172323 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-89d55af7-b669-4811-a124-534f601dcc74 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d058c2b40343a6a3e2e46f6b2bab0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb95e8d0a84b76a5d141815451ceae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:25.181000 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-89d55af7-b669-4811-a124-534f601dcc74 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] 10.222.0.20 "GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5" status: 200 len: 1552 microversion: 2.1 time: 0.292475 Aug 31 01:23:25.181577 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 71/139] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:24 2022] GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5 => generated 1552 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:25.708112 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-823e2e75-4e6c-49bf-9701-b0bb1b598b0c req-95001608-1f4b-4d88-b079-96160d33eb51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f2e4287-f02a-4d2f-a669-621ae355fce5", "name": "network-vif-deleted", "tag": "c7dd3835-d8c2-4dee-8cb0-6f3061af7f54"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:23:25.715056 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-823e2e75-4e6c-49bf-9701-b0bb1b598b0c req-95001608-1f4b-4d88-b079-96160d33eb51 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:25.715839 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-823e2e75-4e6c-49bf-9701-b0bb1b598b0c req-95001608-1f4b-4d88-b079-96160d33eb51 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:25.716275 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-823e2e75-4e6c-49bf-9701-b0bb1b598b0c req-95001608-1f4b-4d88-b079-96160d33eb51 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:25.731518 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-823e2e75-4e6c-49bf-9701-b0bb1b598b0c req-95001608-1f4b-4d88-b079-96160d33eb51 service nova] Creating event network-vif-deleted:c7dd3835-d8c2-4dee-8cb0-6f3061af7f54 for instance 3f2e4287-f02a-4d2f-a669-621ae355fce5 on hv-cinder-85528 Aug 31 01:23:25.736551 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-823e2e75-4e6c-49bf-9701-b0bb1b598b0c req-95001608-1f4b-4d88-b079-96160d33eb51 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038460 Aug 31 01:23:25.737323 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 69/140] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:23:25.889348 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-8e90e5fe-e7a6-4f51-afbf-83a996615a9b tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:25.889965 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-8e90e5fe-e7a6-4f51-afbf-83a996615a9b tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:25.903454 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8e90e5fe-e7a6-4f51-afbf-83a996615a9b tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:25.903454 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8e90e5fe-e7a6-4f51-afbf-83a996615a9b tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:25.903454 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8e90e5fe-e7a6-4f51-afbf-83a996615a9b tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:25.904229 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8e90e5fe-e7a6-4f51-afbf-83a996615a9b tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:25.905548 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8e90e5fe-e7a6-4f51-afbf-83a996615a9b tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:25.905976 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8e90e5fe-e7a6-4f51-afbf-83a996615a9b tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:26.055024 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-8e90e5fe-e7a6-4f51-afbf-83a996615a9b tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:26.062849 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-8e90e5fe-e7a6-4f51-afbf-83a996615a9b tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 200 len: 1522 microversion: 2.1 time: 0.186980 Aug 31 01:23:26.076507 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 72/141] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:25 2022] GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:26.205629 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-47a47c7b-75fb-416b-bdcb-8080b9f94c8d tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:26.207050 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-47a47c7b-75fb-416b-bdcb-8080b9f94c8d tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] [instance: 3f2e4287-f02a-4d2f-a669-621ae355fce5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:26.214943 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-47a47c7b-75fb-416b-bdcb-8080b9f94c8d tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:26.215687 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-47a47c7b-75fb-416b-bdcb-8080b9f94c8d tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:26.216492 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-47a47c7b-75fb-416b-bdcb-8080b9f94c8d tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:26.217494 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-47a47c7b-75fb-416b-bdcb-8080b9f94c8d tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:26.218156 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-47a47c7b-75fb-416b-bdcb-8080b9f94c8d tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:26.218699 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-47a47c7b-75fb-416b-bdcb-8080b9f94c8d tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:26.293741 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-47a47c7b-75fb-416b-bdcb-8080b9f94c8d tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d058c2b40343a6a3e2e46f6b2bab0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb95e8d0a84b76a5d141815451ceae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:26.301905 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-47a47c7b-75fb-416b-bdcb-8080b9f94c8d tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] 10.222.0.20 "GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5" status: 200 len: 1344 microversion: 2.1 time: 0.102282 Aug 31 01:23:26.302644 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 70/142] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:26 2022] GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5 => generated 1344 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:27.083632 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-62cbc552-d0f3-4a65-9c34-7974520f06b1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:27.084267 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-62cbc552-d0f3-4a65-9c34-7974520f06b1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:27.090799 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-62cbc552-d0f3-4a65-9c34-7974520f06b1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:27.091387 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-62cbc552-d0f3-4a65-9c34-7974520f06b1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:27.091831 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-62cbc552-d0f3-4a65-9c34-7974520f06b1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:27.092522 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-62cbc552-d0f3-4a65-9c34-7974520f06b1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:27.093039 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-62cbc552-d0f3-4a65-9c34-7974520f06b1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:27.093470 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-62cbc552-d0f3-4a65-9c34-7974520f06b1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:27.226296 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-62cbc552-d0f3-4a65-9c34-7974520f06b1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:27.234498 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-62cbc552-d0f3-4a65-9c34-7974520f06b1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 200 len: 1522 microversion: 2.1 time: 0.154736 Aug 31 01:23:27.235373 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 73/143] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:27 2022] GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:23:27.322903 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-4bfa826c-6fab-4840-a8f7-089970cb9379 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:27.323418 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-4bfa826c-6fab-4840-a8f7-089970cb9379 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] [instance: 3f2e4287-f02a-4d2f-a669-621ae355fce5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:27.329633 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4bfa826c-6fab-4840-a8f7-089970cb9379 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:27.330109 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4bfa826c-6fab-4840-a8f7-089970cb9379 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:27.330534 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4bfa826c-6fab-4840-a8f7-089970cb9379 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:27.331205 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4bfa826c-6fab-4840-a8f7-089970cb9379 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:27.331651 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4bfa826c-6fab-4840-a8f7-089970cb9379 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:27.332066 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4bfa826c-6fab-4840-a8f7-089970cb9379 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:27.364794 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4bfa826c-6fab-4840-a8f7-089970cb9379 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:27.365264 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4bfa826c-6fab-4840-a8f7-089970cb9379 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:27.365688 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4bfa826c-6fab-4840-a8f7-089970cb9379 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:27.366130 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.objects.instance [None req-4bfa826c-6fab-4840-a8f7-089970cb9379 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lazy-loading 'fault' on Instance uuid 3f2e4287-f02a-4d2f-a669-621ae355fce5 {{(pid=121025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:23:27.410216 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-4bfa826c-6fab-4840-a8f7-089970cb9379 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d058c2b40343a6a3e2e46f6b2bab0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb95e8d0a84b76a5d141815451ceae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:27.419005 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-4bfa826c-6fab-4840-a8f7-089970cb9379 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] 10.222.0.20 "GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5" status: 200 len: 1349 microversion: 2.1 time: 0.099994 Aug 31 01:23:27.419570 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 71/144] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:27 2022] GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5 => generated 1349 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:28.255274 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-7e46f09f-7da2-404f-84eb-e7297acee894 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:28.255986 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-7e46f09f-7da2-404f-84eb-e7297acee894 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:28.262554 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7e46f09f-7da2-404f-84eb-e7297acee894 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:28.263039 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7e46f09f-7da2-404f-84eb-e7297acee894 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:28.263468 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7e46f09f-7da2-404f-84eb-e7297acee894 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:28.264157 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7e46f09f-7da2-404f-84eb-e7297acee894 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:28.264606 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7e46f09f-7da2-404f-84eb-e7297acee894 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:28.265046 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7e46f09f-7da2-404f-84eb-e7297acee894 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:28.414241 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-7e46f09f-7da2-404f-84eb-e7297acee894 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:28.421985 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-7e46f09f-7da2-404f-84eb-e7297acee894 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 200 len: 1522 microversion: 2.1 time: 0.170477 Aug 31 01:23:28.422653 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 74/145] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:28 2022] GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:28.439574 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-c06d83e0-4c18-4e9e-88c4-348369d32e18 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:28.440268 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-c06d83e0-4c18-4e9e-88c4-348369d32e18 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] [instance: 3f2e4287-f02a-4d2f-a669-621ae355fce5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:28.447570 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c06d83e0-4c18-4e9e-88c4-348369d32e18 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:28.448072 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c06d83e0-4c18-4e9e-88c4-348369d32e18 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:28.448508 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c06d83e0-4c18-4e9e-88c4-348369d32e18 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:28.449233 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c06d83e0-4c18-4e9e-88c4-348369d32e18 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:28.449712 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c06d83e0-4c18-4e9e-88c4-348369d32e18 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:28.450132 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c06d83e0-4c18-4e9e-88c4-348369d32e18 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:28.485759 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c06d83e0-4c18-4e9e-88c4-348369d32e18 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:28.486343 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c06d83e0-4c18-4e9e-88c4-348369d32e18 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:28.486779 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c06d83e0-4c18-4e9e-88c4-348369d32e18 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:28.487233 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.objects.instance [None req-c06d83e0-4c18-4e9e-88c4-348369d32e18 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lazy-loading 'fault' on Instance uuid 3f2e4287-f02a-4d2f-a669-621ae355fce5 {{(pid=121025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:23:28.530257 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-c06d83e0-4c18-4e9e-88c4-348369d32e18 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d058c2b40343a6a3e2e46f6b2bab0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb95e8d0a84b76a5d141815451ceae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:28.539232 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-c06d83e0-4c18-4e9e-88c4-348369d32e18 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] 10.222.0.20 "GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5" status: 200 len: 1349 microversion: 2.1 time: 0.102900 Aug 31 01:23:28.539941 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 72/146] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:28 2022] GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5 => generated 1349 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:29.442687 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-c97874fe-1bf9-42d3-89f6-332d0cf56424 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:29.443299 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-c97874fe-1bf9-42d3-89f6-332d0cf56424 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:29.450054 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c97874fe-1bf9-42d3-89f6-332d0cf56424 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:29.450532 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c97874fe-1bf9-42d3-89f6-332d0cf56424 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:29.450996 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c97874fe-1bf9-42d3-89f6-332d0cf56424 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:29.451681 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c97874fe-1bf9-42d3-89f6-332d0cf56424 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:29.452131 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c97874fe-1bf9-42d3-89f6-332d0cf56424 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:29.452541 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c97874fe-1bf9-42d3-89f6-332d0cf56424 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:29.559498 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-65c29519-a9ee-430e-990a-c6d157c2fc99 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:29.560284 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-65c29519-a9ee-430e-990a-c6d157c2fc99 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] [instance: 3f2e4287-f02a-4d2f-a669-621ae355fce5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:29.566552 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-65c29519-a9ee-430e-990a-c6d157c2fc99 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:29.567273 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-65c29519-a9ee-430e-990a-c6d157c2fc99 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:29.567774 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-65c29519-a9ee-430e-990a-c6d157c2fc99 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:29.568534 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-65c29519-a9ee-430e-990a-c6d157c2fc99 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:29.569088 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-65c29519-a9ee-430e-990a-c6d157c2fc99 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:29.569585 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-65c29519-a9ee-430e-990a-c6d157c2fc99 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:29.597607 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-c97874fe-1bf9-42d3-89f6-332d0cf56424 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:29.602862 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-65c29519-a9ee-430e-990a-c6d157c2fc99 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:29.603346 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-65c29519-a9ee-430e-990a-c6d157c2fc99 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:29.603798 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-65c29519-a9ee-430e-990a-c6d157c2fc99 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:29.610051 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.objects.instance [None req-65c29519-a9ee-430e-990a-c6d157c2fc99 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lazy-loading 'fault' on Instance uuid 3f2e4287-f02a-4d2f-a669-621ae355fce5 {{(pid=121025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:23:29.610196 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-c97874fe-1bf9-42d3-89f6-332d0cf56424 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 200 len: 1522 microversion: 2.1 time: 0.168128 Aug 31 01:23:29.610196 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 75/147] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:29 2022] GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:29.672186 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-65c29519-a9ee-430e-990a-c6d157c2fc99 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d058c2b40343a6a3e2e46f6b2bab0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb95e8d0a84b76a5d141815451ceae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:29.682014 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-65c29519-a9ee-430e-990a-c6d157c2fc99 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] 10.222.0.20 "GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5" status: 200 len: 1349 microversion: 2.1 time: 0.125663 Aug 31 01:23:29.683470 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 73/148] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:29 2022] GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5 => generated 1349 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:23:30.628885 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-b8c3bd9b-3784-4f8b-b5e2-2831cf50e581 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:30.631681 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-b8c3bd9b-3784-4f8b-b5e2-2831cf50e581 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:30.638130 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b8c3bd9b-3784-4f8b-b5e2-2831cf50e581 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:30.641119 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b8c3bd9b-3784-4f8b-b5e2-2831cf50e581 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:30.641119 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b8c3bd9b-3784-4f8b-b5e2-2831cf50e581 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:30.641119 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b8c3bd9b-3784-4f8b-b5e2-2831cf50e581 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:30.641119 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b8c3bd9b-3784-4f8b-b5e2-2831cf50e581 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:30.641468 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b8c3bd9b-3784-4f8b-b5e2-2831cf50e581 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:30.705155 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-63280856-231a-469b-92fb-cd8ec3feec11 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:30.710106 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-63280856-231a-469b-92fb-cd8ec3feec11 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] [instance: 3f2e4287-f02a-4d2f-a669-621ae355fce5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:30.713601 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-63280856-231a-469b-92fb-cd8ec3feec11 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:30.714505 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-63280856-231a-469b-92fb-cd8ec3feec11 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:30.715019 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-63280856-231a-469b-92fb-cd8ec3feec11 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:30.716176 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-63280856-231a-469b-92fb-cd8ec3feec11 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:30.716697 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-63280856-231a-469b-92fb-cd8ec3feec11 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:30.717299 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-63280856-231a-469b-92fb-cd8ec3feec11 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:30.770905 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-63280856-231a-469b-92fb-cd8ec3feec11 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:30.776599 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-63280856-231a-469b-92fb-cd8ec3feec11 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:30.776599 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-63280856-231a-469b-92fb-cd8ec3feec11 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:30.776599 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.objects.instance [None req-63280856-231a-469b-92fb-cd8ec3feec11 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lazy-loading 'fault' on Instance uuid 3f2e4287-f02a-4d2f-a669-621ae355fce5 {{(pid=121025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:23:30.829350 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-b8c3bd9b-3784-4f8b-b5e2-2831cf50e581 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:30.831737 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-63280856-231a-469b-92fb-cd8ec3feec11 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d058c2b40343a6a3e2e46f6b2bab0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb95e8d0a84b76a5d141815451ceae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:30.837594 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-b8c3bd9b-3784-4f8b-b5e2-2831cf50e581 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 200 len: 1522 microversion: 2.1 time: 0.212776 Aug 31 01:23:30.838838 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 76/149] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:30 2022] GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:30.841023 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-63280856-231a-469b-92fb-cd8ec3feec11 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] 10.222.0.20 "GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5" status: 200 len: 1303 microversion: 2.1 time: 0.140195 Aug 31 01:23:30.854237 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 74/150] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:30 2022] GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5 => generated 1303 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:31.859088 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-e547f793-010c-42ae-9e14-7e883883ca1a tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:31.861293 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-e547f793-010c-42ae-9e14-7e883883ca1a tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:31.862497 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-75a3760a-0849-4ecf-9624-35bcd88676b6 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:31.863117 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-75a3760a-0849-4ecf-9624-35bcd88676b6 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] [instance: 3f2e4287-f02a-4d2f-a669-621ae355fce5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:31.867027 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e547f793-010c-42ae-9e14-7e883883ca1a tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:31.867827 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e547f793-010c-42ae-9e14-7e883883ca1a tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:31.868275 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e547f793-010c-42ae-9e14-7e883883ca1a tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:31.869005 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e547f793-010c-42ae-9e14-7e883883ca1a tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:31.869459 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e547f793-010c-42ae-9e14-7e883883ca1a tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:31.869883 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e547f793-010c-42ae-9e14-7e883883ca1a tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:31.869992 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-75a3760a-0849-4ecf-9624-35bcd88676b6 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:31.870474 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-75a3760a-0849-4ecf-9624-35bcd88676b6 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:31.870905 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-75a3760a-0849-4ecf-9624-35bcd88676b6 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:31.871596 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-75a3760a-0849-4ecf-9624-35bcd88676b6 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:31.872315 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-75a3760a-0849-4ecf-9624-35bcd88676b6 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:31.872810 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-75a3760a-0849-4ecf-9624-35bcd88676b6 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:31.888597 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.wsgi [None req-75a3760a-0849-4ecf-9624-35bcd88676b6 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] HTTP exception thrown: Instance 3f2e4287-f02a-4d2f-a669-621ae355fce5 could not be found. Aug 31 01:23:31.894503 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-75a3760a-0849-4ecf-9624-35bcd88676b6 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Request method failure captured: Aug 31 01:23:31.894503 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: request: GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5 HTTP/1.1 Aug 31 01:23:31.894503 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept: application/json Aug 31 01:23:31.894503 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept-Encoding: identity Aug 31 01:23:31.894503 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Connection: close Aug 31 01:23:31.894503 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Length: 0 Aug 31 01:23:31.894503 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Type: application/json Aug 31 01:23:31.894503 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Host: 10.222.0.20 Aug 31 01:23:31.894503 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Openstack-System-Scope: None Aug 31 01:23:31.894503 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: User-Agent: python-urllib3/1.26.12 Aug 31 01:23:31.894503 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Auth-Token: gAAAAABjDrfUZhstYrRGyicA2WZFaE21w-VPVF28nlvQFWejjWv2t0qbpyywQVjHj1Zc_CrfZAru6VIjzbRhW7DBzorOk2n1Gn5QP5kRbTw76vIRxOSecJq0JXopP1YB5klr1b5ZbtBbuJo6a429INoL3o5SwPPfzEXOkqxW7pquaNyrhFollUk Aug 31 01:23:31.894503 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Id: None Aug 31 01:23:31.894503 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Name: None Aug 31 01:23:31.894503 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Identity-Status: Confirmed Aug 31 01:23:31.894503 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Is-Admin-Project: True Aug 31 01:23:31.894503 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Id: default Aug 31 01:23:31.894503 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Name: Default Aug 31 01:23:31.894503 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Id: 3abb95e8d0a84b76a5d141815451ceae Aug 31 01:23:31.894503 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Name: tempest-DeleteServersTestJSON-1098225955 Aug 31 01:23:31.894503 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Role: member,reader Aug 31 01:23:31.894503 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Roles: member,reader Aug 31 01:23:31.895986 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3abb95e8d0a84b76a5d141815451ceae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3abb95e8d0a84b76a5d141815451ceae", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3abb95e8d0a84b76a5d141815451ceae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3abb95e8d0a84b76a5d141815451ceae"}]}] Aug 31 01:23:31.895986 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant: tempest-DeleteServersTestJSON-1098225955 Aug 31 01:23:31.895986 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Id: 3abb95e8d0a84b76a5d141815451ceae Aug 31 01:23:31.895986 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Name: tempest-DeleteServersTestJSON-1098225955 Aug 31 01:23:31.895986 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User: tempest-DeleteServersTestJSON-1098225955-project Aug 31 01:23:31.895986 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Id: default Aug 31 01:23:31.895986 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Name: Default Aug 31 01:23:31.895986 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Id: b7d058c2b40343a6a3e2e46f6b2bab0e Aug 31 01:23:31.895986 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Name: tempest-DeleteServersTestJSON-1098225955-project Aug 31 01:23:31.895986 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: method: > Aug 31 01:23:31.895986 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: exception: Instance 3f2e4287-f02a-4d2f-a669-621ae355fce5 could not be found. Aug 31 01:23:31.895986 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: action_args: {'id': '3f2e4287-f02a-4d2f-a669-621ae355fce5'} Aug 31 01:23:31.896684 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:23:31.896684 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:23:31.896684 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:23:31.896684 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:23:31.896684 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:23:31.896684 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:23:31.896684 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:23:31.896684 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:23:31.896684 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:23:31.896684 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:23:31.896684 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f2e4287-f02a-4d2f-a669-621ae355fce5 could not be found. Aug 31 01:23:31.896684 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:23:31.896684 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:23:31.896684 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:23:31.896684 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:23:31.896684 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:23:31.896684 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:23:31.896684 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:23:31.896684 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:23:31.896684 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:23:31.897833 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:23:31.897833 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:23:31.897833 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:23:31.897833 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:23:31.897833 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:23:31.897833 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:23:31.897833 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:23:31.897833 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f2e4287-f02a-4d2f-a669-621ae355fce5 could not be found. Aug 31 01:23:31.897833 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:23:31.897833 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:23:31.897833 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:23:31.897833 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:23:31.897833 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:23:31.897833 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:23:31.897833 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:23:31.897833 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:23:31.897833 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f2e4287-f02a-4d2f-a669-621ae355fce5 could not be found. Aug 31 01:23:31.897833 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:23:31.898779 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-75a3760a-0849-4ecf-9624-35bcd88676b6 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Returning 404 to user: Instance 3f2e4287-f02a-4d2f-a669-621ae355fce5 could not be found. {{(pid=121025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:23:31.898779 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-75a3760a-0849-4ecf-9624-35bcd88676b6 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] 10.222.0.20 "GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5" status: 404 len: 111 microversion: 2.1 time: 0.038055 Aug 31 01:23:31.898779 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 75/151] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:31 2022] GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 01:23:32.025269 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-50bb5246-f88b-42e7-b51a-af7126f987c0 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:32.027646 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-50bb5246-f88b-42e7-b51a-af7126f987c0 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] [instance: 3f2e4287-f02a-4d2f-a669-621ae355fce5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:32.027784 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-e547f793-010c-42ae-9e14-7e883883ca1a tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:32.033796 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-50bb5246-f88b-42e7-b51a-af7126f987c0 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:32.034467 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-50bb5246-f88b-42e7-b51a-af7126f987c0 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:32.035000 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-50bb5246-f88b-42e7-b51a-af7126f987c0 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:32.035373 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-e547f793-010c-42ae-9e14-7e883883ca1a tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 200 len: 1522 microversion: 2.1 time: 0.180660 Aug 31 01:23:32.035581 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-50bb5246-f88b-42e7-b51a-af7126f987c0 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:32.035971 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 77/152] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:31 2022] GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:32.036085 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-50bb5246-f88b-42e7-b51a-af7126f987c0 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:32.036477 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-50bb5246-f88b-42e7-b51a-af7126f987c0 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:32.049429 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.wsgi [None req-50bb5246-f88b-42e7-b51a-af7126f987c0 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] HTTP exception thrown: Instance 3f2e4287-f02a-4d2f-a669-621ae355fce5 could not be found. Aug 31 01:23:32.051189 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-50bb5246-f88b-42e7-b51a-af7126f987c0 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Request method failure captured: Aug 31 01:23:32.051189 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: request: GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5/os-volume_attachments HTTP/1.1 Aug 31 01:23:32.051189 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept: application/json Aug 31 01:23:32.051189 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept-Encoding: identity Aug 31 01:23:32.051189 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Connection: close Aug 31 01:23:32.051189 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Length: 0 Aug 31 01:23:32.051189 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Type: application/json Aug 31 01:23:32.051189 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Host: 10.222.0.20 Aug 31 01:23:32.051189 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Openstack-System-Scope: None Aug 31 01:23:32.051189 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: User-Agent: python-urllib3/1.26.12 Aug 31 01:23:32.051189 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Auth-Token: gAAAAABjDrfUZhstYrRGyicA2WZFaE21w-VPVF28nlvQFWejjWv2t0qbpyywQVjHj1Zc_CrfZAru6VIjzbRhW7DBzorOk2n1Gn5QP5kRbTw76vIRxOSecJq0JXopP1YB5klr1b5ZbtBbuJo6a429INoL3o5SwPPfzEXOkqxW7pquaNyrhFollUk Aug 31 01:23:32.051189 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Id: None Aug 31 01:23:32.051189 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Name: None Aug 31 01:23:32.051189 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Identity-Status: Confirmed Aug 31 01:23:32.051189 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Is-Admin-Project: True Aug 31 01:23:32.051189 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Id: default Aug 31 01:23:32.051189 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Name: Default Aug 31 01:23:32.051189 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Id: 3abb95e8d0a84b76a5d141815451ceae Aug 31 01:23:32.051189 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Name: tempest-DeleteServersTestJSON-1098225955 Aug 31 01:23:32.051189 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Role: member,reader Aug 31 01:23:32.051189 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Roles: member,reader Aug 31 01:23:32.060422 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3abb95e8d0a84b76a5d141815451ceae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3abb95e8d0a84b76a5d141815451ceae", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3abb95e8d0a84b76a5d141815451ceae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3abb95e8d0a84b76a5d141815451ceae"}]}] Aug 31 01:23:32.060422 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant: tempest-DeleteServersTestJSON-1098225955 Aug 31 01:23:32.060422 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Id: 3abb95e8d0a84b76a5d141815451ceae Aug 31 01:23:32.060422 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Name: tempest-DeleteServersTestJSON-1098225955 Aug 31 01:23:32.060422 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User: tempest-DeleteServersTestJSON-1098225955-project Aug 31 01:23:32.060422 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Id: default Aug 31 01:23:32.060422 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Name: Default Aug 31 01:23:32.060422 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Id: b7d058c2b40343a6a3e2e46f6b2bab0e Aug 31 01:23:32.060422 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Name: tempest-DeleteServersTestJSON-1098225955-project Aug 31 01:23:32.060422 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: method: > Aug 31 01:23:32.060422 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: exception: Instance 3f2e4287-f02a-4d2f-a669-621ae355fce5 could not be found. Aug 31 01:23:32.060422 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: action_args: {'server_id': '3f2e4287-f02a-4d2f-a669-621ae355fce5'} Aug 31 01:23:32.061249 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:23:32.061249 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:23:32.061249 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:23:32.061249 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:23:32.061249 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:23:32.061249 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:23:32.061249 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:23:32.061249 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:23:32.061249 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:23:32.061249 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:23:32.061249 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f2e4287-f02a-4d2f-a669-621ae355fce5 could not be found. Aug 31 01:23:32.061249 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:23:32.061249 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:23:32.061249 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:23:32.061249 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:23:32.061249 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:23:32.061249 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:23:32.061249 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:23:32.061249 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:23:32.061249 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:23:32.063036 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:23:32.063036 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 01:23:32.063036 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 01:23:32.063036 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 01:23:32.063036 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 01:23:32.063036 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 31 01:23:32.063036 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 31 01:23:32.063036 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:23:32.063036 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:23:32.063036 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f2e4287-f02a-4d2f-a669-621ae355fce5 could not be found. Aug 31 01:23:32.063036 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:23:32.063036 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:23:32.063036 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:23:32.063036 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:23:32.063036 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:23:32.063036 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:23:32.063036 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:23:32.063036 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:23:32.063036 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f2e4287-f02a-4d2f-a669-621ae355fce5 could not be found. Aug 31 01:23:32.063036 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:23:32.064271 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-50bb5246-f88b-42e7-b51a-af7126f987c0 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Returning 404 to user: Instance 3f2e4287-f02a-4d2f-a669-621ae355fce5 could not be found. {{(pid=121025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:23:32.064271 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-50bb5246-f88b-42e7-b51a-af7126f987c0 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] 10.222.0.20 "GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033658 Aug 31 01:23:32.064271 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 76/153] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 01:23:32 2022] GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:23:33.057383 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-3f50c521-425e-468d-b542-73fd394f017e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:33.058122 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-3f50c521-425e-468d-b542-73fd394f017e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:33.066103 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3f50c521-425e-468d-b542-73fd394f017e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:33.067252 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3f50c521-425e-468d-b542-73fd394f017e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:33.067966 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3f50c521-425e-468d-b542-73fd394f017e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:33.068744 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3f50c521-425e-468d-b542-73fd394f017e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:33.069709 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3f50c521-425e-468d-b542-73fd394f017e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:33.070340 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3f50c521-425e-468d-b542-73fd394f017e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:33.317424 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-3f50c521-425e-468d-b542-73fd394f017e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:33.326020 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-3f50c521-425e-468d-b542-73fd394f017e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 200 len: 1522 microversion: 2.1 time: 0.273170 Aug 31 01:23:33.326615 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 78/154] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:33 2022] GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:33.407657 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-e0b1e0b6-d5f0-46e1-b58e-bc316764f581 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:33.408157 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-e0b1e0b6-d5f0-46e1-b58e-bc316764f581 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] [instance: 3f2e4287-f02a-4d2f-a669-621ae355fce5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:33.415127 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e0b1e0b6-d5f0-46e1-b58e-bc316764f581 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:33.415615 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e0b1e0b6-d5f0-46e1-b58e-bc316764f581 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:33.416070 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e0b1e0b6-d5f0-46e1-b58e-bc316764f581 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:33.416837 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e0b1e0b6-d5f0-46e1-b58e-bc316764f581 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:33.417293 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e0b1e0b6-d5f0-46e1-b58e-bc316764f581 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:33.417725 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e0b1e0b6-d5f0-46e1-b58e-bc316764f581 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:33.432006 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.wsgi [None req-e0b1e0b6-d5f0-46e1-b58e-bc316764f581 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] HTTP exception thrown: Instance 3f2e4287-f02a-4d2f-a669-621ae355fce5 could not be found. Aug 31 01:23:33.433578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-e0b1e0b6-d5f0-46e1-b58e-bc316764f581 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Request method failure captured: Aug 31 01:23:33.433578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: request: DELETE /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5 HTTP/1.1 Aug 31 01:23:33.433578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept: application/json Aug 31 01:23:33.433578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept-Encoding: identity Aug 31 01:23:33.433578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Connection: close Aug 31 01:23:33.433578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Length: 0 Aug 31 01:23:33.433578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Type: application/json Aug 31 01:23:33.433578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Host: 10.222.0.20 Aug 31 01:23:33.433578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Openstack-System-Scope: None Aug 31 01:23:33.433578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: User-Agent: python-urllib3/1.26.12 Aug 31 01:23:33.433578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Auth-Token: gAAAAABjDrfUZhstYrRGyicA2WZFaE21w-VPVF28nlvQFWejjWv2t0qbpyywQVjHj1Zc_CrfZAru6VIjzbRhW7DBzorOk2n1Gn5QP5kRbTw76vIRxOSecJq0JXopP1YB5klr1b5ZbtBbuJo6a429INoL3o5SwPPfzEXOkqxW7pquaNyrhFollUk Aug 31 01:23:33.433578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Id: None Aug 31 01:23:33.433578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Name: None Aug 31 01:23:33.433578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Identity-Status: Confirmed Aug 31 01:23:33.433578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Is-Admin-Project: True Aug 31 01:23:33.433578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Id: default Aug 31 01:23:33.433578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Name: Default Aug 31 01:23:33.433578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Id: 3abb95e8d0a84b76a5d141815451ceae Aug 31 01:23:33.433578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Name: tempest-DeleteServersTestJSON-1098225955 Aug 31 01:23:33.433578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Role: member,reader Aug 31 01:23:33.433578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Roles: member,reader Aug 31 01:23:33.434969 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3abb95e8d0a84b76a5d141815451ceae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3abb95e8d0a84b76a5d141815451ceae", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3abb95e8d0a84b76a5d141815451ceae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3abb95e8d0a84b76a5d141815451ceae"}]}] Aug 31 01:23:33.434969 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant: tempest-DeleteServersTestJSON-1098225955 Aug 31 01:23:33.434969 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Id: 3abb95e8d0a84b76a5d141815451ceae Aug 31 01:23:33.434969 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Name: tempest-DeleteServersTestJSON-1098225955 Aug 31 01:23:33.434969 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User: tempest-DeleteServersTestJSON-1098225955-project Aug 31 01:23:33.434969 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Id: default Aug 31 01:23:33.434969 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Name: Default Aug 31 01:23:33.434969 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Id: b7d058c2b40343a6a3e2e46f6b2bab0e Aug 31 01:23:33.434969 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Name: tempest-DeleteServersTestJSON-1098225955-project Aug 31 01:23:33.434969 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: method: > Aug 31 01:23:33.434969 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: exception: Instance 3f2e4287-f02a-4d2f-a669-621ae355fce5 could not be found. Aug 31 01:23:33.434969 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: action_args: {'id': '3f2e4287-f02a-4d2f-a669-621ae355fce5'} Aug 31 01:23:33.435708 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:23:33.435708 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:23:33.435708 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:23:33.435708 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:23:33.435708 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:23:33.435708 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:23:33.435708 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:23:33.435708 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:23:33.435708 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:23:33.435708 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:23:33.435708 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f2e4287-f02a-4d2f-a669-621ae355fce5 could not be found. Aug 31 01:23:33.435708 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:23:33.435708 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:23:33.435708 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:23:33.435708 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:23:33.435708 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:23:33.435708 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:23:33.435708 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:23:33.435708 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:23:33.435708 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:23:33.436865 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:23:33.436865 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 01:23:33.436865 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 01:23:33.436865 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 01:23:33.436865 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 01:23:33.436865 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:23:33.436865 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:23:33.436865 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:23:33.436865 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:23:33.436865 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f2e4287-f02a-4d2f-a669-621ae355fce5 could not be found. Aug 31 01:23:33.436865 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:23:33.436865 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:23:33.436865 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:23:33.436865 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:23:33.436865 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:23:33.436865 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:23:33.436865 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:23:33.436865 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:23:33.436865 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f2e4287-f02a-4d2f-a669-621ae355fce5 could not be found. Aug 31 01:23:33.436865 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:23:33.438031 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-e0b1e0b6-d5f0-46e1-b58e-bc316764f581 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Returning 404 to user: Instance 3f2e4287-f02a-4d2f-a669-621ae355fce5 could not be found. {{(pid=121025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:23:33.438031 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-e0b1e0b6-d5f0-46e1-b58e-bc316764f581 tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5" status: 404 len: 111 microversion: 2.1 time: 0.031632 Aug 31 01:23:33.438031 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 77/155] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 01:23:33 2022] DELETE /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:23:33.443646 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-31084433-4434-4da7-8b22-4472e9b10b7e tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:33.444256 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-31084433-4434-4da7-8b22-4472e9b10b7e tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] [instance: 3f2e4287-f02a-4d2f-a669-621ae355fce5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:33.450491 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-31084433-4434-4da7-8b22-4472e9b10b7e tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:33.456366 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-31084433-4434-4da7-8b22-4472e9b10b7e tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:33.456366 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-31084433-4434-4da7-8b22-4472e9b10b7e tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:33.456366 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-31084433-4434-4da7-8b22-4472e9b10b7e tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:33.456366 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-31084433-4434-4da7-8b22-4472e9b10b7e tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:33.456866 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-31084433-4434-4da7-8b22-4472e9b10b7e tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:33.468310 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.wsgi [None req-31084433-4434-4da7-8b22-4472e9b10b7e tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] HTTP exception thrown: Instance 3f2e4287-f02a-4d2f-a669-621ae355fce5 could not be found. Aug 31 01:23:33.472920 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-31084433-4434-4da7-8b22-4472e9b10b7e tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Request method failure captured: Aug 31 01:23:33.472920 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: request: GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5 HTTP/1.1 Aug 31 01:23:33.472920 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept: application/json Aug 31 01:23:33.472920 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept-Encoding: identity Aug 31 01:23:33.472920 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Connection: close Aug 31 01:23:33.472920 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Length: 0 Aug 31 01:23:33.472920 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Type: application/json Aug 31 01:23:33.472920 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Host: 10.222.0.20 Aug 31 01:23:33.472920 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Openstack-System-Scope: None Aug 31 01:23:33.472920 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: User-Agent: python-urllib3/1.26.12 Aug 31 01:23:33.472920 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Auth-Token: gAAAAABjDrfUZhstYrRGyicA2WZFaE21w-VPVF28nlvQFWejjWv2t0qbpyywQVjHj1Zc_CrfZAru6VIjzbRhW7DBzorOk2n1Gn5QP5kRbTw76vIRxOSecJq0JXopP1YB5klr1b5ZbtBbuJo6a429INoL3o5SwPPfzEXOkqxW7pquaNyrhFollUk Aug 31 01:23:33.472920 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Id: None Aug 31 01:23:33.472920 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Name: None Aug 31 01:23:33.472920 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Identity-Status: Confirmed Aug 31 01:23:33.472920 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Is-Admin-Project: True Aug 31 01:23:33.472920 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Id: default Aug 31 01:23:33.472920 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Name: Default Aug 31 01:23:33.472920 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Id: 3abb95e8d0a84b76a5d141815451ceae Aug 31 01:23:33.472920 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Name: tempest-DeleteServersTestJSON-1098225955 Aug 31 01:23:33.472920 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Role: member,reader Aug 31 01:23:33.472920 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Roles: member,reader Aug 31 01:23:33.474411 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3abb95e8d0a84b76a5d141815451ceae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3abb95e8d0a84b76a5d141815451ceae", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3abb95e8d0a84b76a5d141815451ceae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3abb95e8d0a84b76a5d141815451ceae"}]}] Aug 31 01:23:33.474411 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant: tempest-DeleteServersTestJSON-1098225955 Aug 31 01:23:33.474411 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Id: 3abb95e8d0a84b76a5d141815451ceae Aug 31 01:23:33.474411 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Name: tempest-DeleteServersTestJSON-1098225955 Aug 31 01:23:33.474411 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User: tempest-DeleteServersTestJSON-1098225955-project Aug 31 01:23:33.474411 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Id: default Aug 31 01:23:33.474411 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Name: Default Aug 31 01:23:33.474411 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Id: b7d058c2b40343a6a3e2e46f6b2bab0e Aug 31 01:23:33.474411 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Name: tempest-DeleteServersTestJSON-1098225955-project Aug 31 01:23:33.474411 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: method: > Aug 31 01:23:33.474411 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: exception: Instance 3f2e4287-f02a-4d2f-a669-621ae355fce5 could not be found. Aug 31 01:23:33.474411 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: action_args: {'id': '3f2e4287-f02a-4d2f-a669-621ae355fce5'} Aug 31 01:23:33.475229 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:23:33.475229 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:23:33.475229 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:23:33.475229 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:23:33.475229 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:23:33.475229 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:23:33.475229 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:23:33.475229 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:23:33.475229 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:23:33.475229 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:23:33.475229 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f2e4287-f02a-4d2f-a669-621ae355fce5 could not be found. Aug 31 01:23:33.475229 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:23:33.475229 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:23:33.475229 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:23:33.475229 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:23:33.475229 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:23:33.475229 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:23:33.475229 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:23:33.475229 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:23:33.475229 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:23:33.476436 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:23:33.476436 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:23:33.476436 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:23:33.476436 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:23:33.476436 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:23:33.476436 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:23:33.476436 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:23:33.476436 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f2e4287-f02a-4d2f-a669-621ae355fce5 could not be found. Aug 31 01:23:33.476436 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:23:33.476436 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:23:33.476436 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:23:33.476436 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:23:33.476436 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:23:33.476436 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:23:33.476436 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:23:33.476436 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:23:33.476436 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f2e4287-f02a-4d2f-a669-621ae355fce5 could not be found. Aug 31 01:23:33.476436 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:23:33.477613 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-31084433-4434-4da7-8b22-4472e9b10b7e tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] Returning 404 to user: Instance 3f2e4287-f02a-4d2f-a669-621ae355fce5 could not be found. {{(pid=121026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:23:33.477613 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-31084433-4434-4da7-8b22-4472e9b10b7e tempest-DeleteServersTestJSON-1098225955 tempest-DeleteServersTestJSON-1098225955-project] 10.222.0.20 "GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5" status: 404 len: 111 microversion: 2.1 time: 0.034846 Aug 31 01:23:33.478421 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 79/156] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:33 2022] GET /compute/v2.1/servers/3f2e4287-f02a-4d2f-a669-621ae355fce5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:23:34.347335 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-e1fc20bb-fc69-4f4e-9a46-86883adc32a9 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:34.348321 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-e1fc20bb-fc69-4f4e-9a46-86883adc32a9 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:34.357953 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e1fc20bb-fc69-4f4e-9a46-86883adc32a9 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:34.358442 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e1fc20bb-fc69-4f4e-9a46-86883adc32a9 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:34.359536 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e1fc20bb-fc69-4f4e-9a46-86883adc32a9 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:34.362016 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e1fc20bb-fc69-4f4e-9a46-86883adc32a9 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:34.362817 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e1fc20bb-fc69-4f4e-9a46-86883adc32a9 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:34.363403 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e1fc20bb-fc69-4f4e-9a46-86883adc32a9 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:34.504560 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-e1fc20bb-fc69-4f4e-9a46-86883adc32a9 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:34.512522 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-e1fc20bb-fc69-4f4e-9a46-86883adc32a9 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 200 len: 1522 microversion: 2.1 time: 0.168914 Aug 31 01:23:34.513219 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 78/157] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:34 2022] GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:35.533688 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-4ea95c21-13f8-4bb3-9b6a-f6d0dfebb353 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:35.534947 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-4ea95c21-13f8-4bb3-9b6a-f6d0dfebb353 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:35.541647 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4ea95c21-13f8-4bb3-9b6a-f6d0dfebb353 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:35.542301 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4ea95c21-13f8-4bb3-9b6a-f6d0dfebb353 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:35.542760 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4ea95c21-13f8-4bb3-9b6a-f6d0dfebb353 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:35.545408 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4ea95c21-13f8-4bb3-9b6a-f6d0dfebb353 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:35.545408 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4ea95c21-13f8-4bb3-9b6a-f6d0dfebb353 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:35.545408 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4ea95c21-13f8-4bb3-9b6a-f6d0dfebb353 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:35.548839 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell1:SELECT=100 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:23:35.733048 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-4ea95c21-13f8-4bb3-9b6a-f6d0dfebb353 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:35.755463 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-4ea95c21-13f8-4bb3-9b6a-f6d0dfebb353 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 200 len: 1522 microversion: 2.1 time: 0.212862 Aug 31 01:23:35.756276 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 80/158] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:35 2022] GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:36.765325 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-9468a534-9c28-402c-80b8-5426e3d767ba tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:36.766454 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-9468a534-9c28-402c-80b8-5426e3d767ba tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:36.775244 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9468a534-9c28-402c-80b8-5426e3d767ba tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:36.775733 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9468a534-9c28-402c-80b8-5426e3d767ba tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:36.776158 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9468a534-9c28-402c-80b8-5426e3d767ba tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:36.776875 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9468a534-9c28-402c-80b8-5426e3d767ba tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:36.777315 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9468a534-9c28-402c-80b8-5426e3d767ba tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:36.777886 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9468a534-9c28-402c-80b8-5426e3d767ba tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:37.014069 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-9468a534-9c28-402c-80b8-5426e3d767ba tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:37.025053 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-9468a534-9c28-402c-80b8-5426e3d767ba tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 200 len: 1522 microversion: 2.1 time: 0.263635 Aug 31 01:23:37.025651 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 79/159] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:36 2022] GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:38.048485 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-74cd6d53-95bc-4032-8bf7-57edf6c6e367 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:38.049195 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-74cd6d53-95bc-4032-8bf7-57edf6c6e367 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:38.056994 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-74cd6d53-95bc-4032-8bf7-57edf6c6e367 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:38.057534 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-74cd6d53-95bc-4032-8bf7-57edf6c6e367 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:38.058494 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-74cd6d53-95bc-4032-8bf7-57edf6c6e367 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:38.059185 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-74cd6d53-95bc-4032-8bf7-57edf6c6e367 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:38.059635 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-74cd6d53-95bc-4032-8bf7-57edf6c6e367 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:38.060055 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-74cd6d53-95bc-4032-8bf7-57edf6c6e367 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:38.203037 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-74cd6d53-95bc-4032-8bf7-57edf6c6e367 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:38.211662 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-74cd6d53-95bc-4032-8bf7-57edf6c6e367 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 200 len: 1522 microversion: 2.1 time: 0.167992 Aug 31 01:23:38.221805 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 81/160] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:38 2022] GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:39.233084 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-cb1a2956-793e-4524-91a7-fdbd1fbfd444 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:39.233084 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-cb1a2956-793e-4524-91a7-fdbd1fbfd444 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:39.239442 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cb1a2956-793e-4524-91a7-fdbd1fbfd444 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:39.240893 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cb1a2956-793e-4524-91a7-fdbd1fbfd444 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:39.240893 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cb1a2956-793e-4524-91a7-fdbd1fbfd444 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:39.241172 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cb1a2956-793e-4524-91a7-fdbd1fbfd444 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:39.241626 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cb1a2956-793e-4524-91a7-fdbd1fbfd444 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:39.242051 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cb1a2956-793e-4524-91a7-fdbd1fbfd444 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:39.389568 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-cb1a2956-793e-4524-91a7-fdbd1fbfd444 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:39.397978 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-cb1a2956-793e-4524-91a7-fdbd1fbfd444 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 200 len: 1522 microversion: 2.1 time: 0.169268 Aug 31 01:23:39.398586 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 80/161] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:39 2022] GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:40.421027 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-abbc3b36-fe83-4986-860b-c9cd04a43082 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:40.422339 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-abbc3b36-fe83-4986-860b-c9cd04a43082 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:40.428259 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-abbc3b36-fe83-4986-860b-c9cd04a43082 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:40.429030 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-abbc3b36-fe83-4986-860b-c9cd04a43082 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:40.429788 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-abbc3b36-fe83-4986-860b-c9cd04a43082 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:40.430470 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-abbc3b36-fe83-4986-860b-c9cd04a43082 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:40.430910 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-abbc3b36-fe83-4986-860b-c9cd04a43082 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:40.431493 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-abbc3b36-fe83-4986-860b-c9cd04a43082 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:40.573510 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-abbc3b36-fe83-4986-860b-c9cd04a43082 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:40.581738 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-abbc3b36-fe83-4986-860b-c9cd04a43082 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 200 len: 1502 microversion: 2.1 time: 0.164810 Aug 31 01:23:40.583214 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 82/162] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:40 2022] GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 1502 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:40.606810 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-373b22b9-3e87-4d57-9f21-f6dae24a99dc tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:40.607476 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-373b22b9-3e87-4d57-9f21-f6dae24a99dc tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: ee6ca45e-29c7-4af8-8aef-72134f23292c] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:40.613964 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-373b22b9-3e87-4d57-9f21-f6dae24a99dc tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:40.614728 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-373b22b9-3e87-4d57-9f21-f6dae24a99dc tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:40.615345 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-373b22b9-3e87-4d57-9f21-f6dae24a99dc tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:40.616027 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-373b22b9-3e87-4d57-9f21-f6dae24a99dc tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:40.616698 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-373b22b9-3e87-4d57-9f21-f6dae24a99dc tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:40.617371 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-373b22b9-3e87-4d57-9f21-f6dae24a99dc tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:40.774976 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-373b22b9-3e87-4d57-9f21-f6dae24a99dc tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:40.783906 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-373b22b9-3e87-4d57-9f21-f6dae24a99dc tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c" status: 200 len: 1516 microversion: 2.1 time: 0.185484 Aug 31 01:23:40.784492 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 81/163] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:40 2022] GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c => generated 1516 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:43.043312 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-ab2570dc-6351-40f4-990f-23c87f80bec1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:23:43.046677 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-ab2570dc-6351-40f4-990f-23c87f80bec1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: ee6ca45e-29c7-4af8-8aef-72134f23292c] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:43.053367 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ab2570dc-6351-40f4-990f-23c87f80bec1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:43.054183 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ab2570dc-6351-40f4-990f-23c87f80bec1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:43.055026 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ab2570dc-6351-40f4-990f-23c87f80bec1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:43.055949 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ab2570dc-6351-40f4-990f-23c87f80bec1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:43.056618 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ab2570dc-6351-40f4-990f-23c87f80bec1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:43.057133 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ab2570dc-6351-40f4-990f-23c87f80bec1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:43.085157 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.objects.instance [None req-ab2570dc-6351-40f4-990f-23c87f80bec1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lazy-loading 'flavor' on Instance uuid ee6ca45e-29c7-4af8-8aef-72134f23292c {{(pid=121026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:23:43.536406 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-ab2570dc-6351-40f4-990f-23c87f80bec1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "POST /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c/action" status: 200 len: 32 microversion: 2.1 time: 0.496827 Aug 31 01:23:43.540877 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 83/164] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 31 01:23:43 2022] POST /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c/action => generated 32 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 01:23:43.547549 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-0c4b612c-3860-4895-92d8-01debae3f0ff tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:43.549196 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-0c4b612c-3860-4895-92d8-01debae3f0ff tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: ee6ca45e-29c7-4af8-8aef-72134f23292c] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:43.556201 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0c4b612c-3860-4895-92d8-01debae3f0ff tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:43.556713 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0c4b612c-3860-4895-92d8-01debae3f0ff tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:43.557190 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0c4b612c-3860-4895-92d8-01debae3f0ff tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:43.557899 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0c4b612c-3860-4895-92d8-01debae3f0ff tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:43.558351 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0c4b612c-3860-4895-92d8-01debae3f0ff tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:43.558773 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0c4b612c-3860-4895-92d8-01debae3f0ff tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:43.753274 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-0c4b612c-3860-4895-92d8-01debae3f0ff tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:43.760439 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:23:43.769760 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-0c4b612c-3860-4895-92d8-01debae3f0ff tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c" status: 200 len: 1522 microversion: 2.1 time: 0.226577 Aug 31 01:23:43.771899 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 82/165] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:43 2022] GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:44.794005 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-5182586a-6bfc-4266-9c79-d7ff6f372769 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:44.795065 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-5182586a-6bfc-4266-9c79-d7ff6f372769 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: ee6ca45e-29c7-4af8-8aef-72134f23292c] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:44.803878 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5182586a-6bfc-4266-9c79-d7ff6f372769 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:44.804412 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5182586a-6bfc-4266-9c79-d7ff6f372769 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:44.804921 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5182586a-6bfc-4266-9c79-d7ff6f372769 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:44.805634 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5182586a-6bfc-4266-9c79-d7ff6f372769 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:44.806119 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5182586a-6bfc-4266-9c79-d7ff6f372769 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:44.806754 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5182586a-6bfc-4266-9c79-d7ff6f372769 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:45.006097 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-5182586a-6bfc-4266-9c79-d7ff6f372769 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:45.014422 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-5182586a-6bfc-4266-9c79-d7ff6f372769 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c" status: 200 len: 1522 microversion: 2.1 time: 0.225908 Aug 31 01:23:45.014997 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 84/166] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:44 2022] GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:46.036086 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-b714f440-4b93-4587-97e5-3f6b511e731d tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:46.037381 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-b714f440-4b93-4587-97e5-3f6b511e731d tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: ee6ca45e-29c7-4af8-8aef-72134f23292c] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:46.053727 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b714f440-4b93-4587-97e5-3f6b511e731d tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:46.054235 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b714f440-4b93-4587-97e5-3f6b511e731d tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:46.054672 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b714f440-4b93-4587-97e5-3f6b511e731d tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:46.055559 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b714f440-4b93-4587-97e5-3f6b511e731d tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:46.056394 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b714f440-4b93-4587-97e5-3f6b511e731d tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:46.056990 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b714f440-4b93-4587-97e5-3f6b511e731d tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:46.434440 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-b714f440-4b93-4587-97e5-3f6b511e731d tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:46.442694 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-b714f440-4b93-4587-97e5-3f6b511e731d tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c" status: 200 len: 1522 microversion: 2.1 time: 0.410989 Aug 31 01:23:46.444875 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 83/167] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:46 2022] GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c => generated 1522 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:46.798644 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-02c8a3f2-81d0-44cb-adf7-99ed74fbd504 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Action: 'create', calling method: .version_select at 0x7f1fe18bf430>, body: {"keypair": {"name": "tempest-keypair-1661791226", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEveVnNKFu0RLUjzKKTZAmng1ruODMoHZhqrLIe00XMFMqpzCVvdtDqFGjnsZOoxWNL+bwdYcPTUVXioyerkeox5hAOG4h3pgFS1Vs8ltCuP0dw+uWldhX2Pfzciq/aybA=="}} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:23:46.844084 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.quota [None req-02c8a3f2-81d0-44cb-adf7-99ed74fbd504 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Getting quotas for project fb863f706c3846db958c9b7fe367c3f5. Resources: {'key_pairs'} {{(pid=121026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 01:23:46.848972 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.quota [None req-02c8a3f2-81d0-44cb-adf7-99ed74fbd504 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Getting quotas for user 1cc3db55df284cd39f28fcfefc619fda and project fb863f706c3846db958c9b7fe367c3f5. Resources: {'key_pairs'} {{(pid=121026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 01:23:47.031594 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-02c8a3f2-81d0-44cb-adf7-99ed74fbd504 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.390628 Aug 31 01:23:47.032784 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 85/168] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Aug 31 01:23:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:23:47.468182 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-11f3683c-a45b-4447-9d9b-3b23116b7673 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:47.469994 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-11f3683c-a45b-4447-9d9b-3b23116b7673 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: ee6ca45e-29c7-4af8-8aef-72134f23292c] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:47.477770 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-11f3683c-a45b-4447-9d9b-3b23116b7673 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:47.478359 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-11f3683c-a45b-4447-9d9b-3b23116b7673 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:47.478867 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-11f3683c-a45b-4447-9d9b-3b23116b7673 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:47.479654 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-11f3683c-a45b-4447-9d9b-3b23116b7673 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:47.480210 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-11f3683c-a45b-4447-9d9b-3b23116b7673 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:47.481407 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-11f3683c-a45b-4447-9d9b-3b23116b7673 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:47.683414 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-11f3683c-a45b-4447-9d9b-3b23116b7673 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:47.694160 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-11f3683c-a45b-4447-9d9b-3b23116b7673 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c" status: 200 len: 1522 microversion: 2.1 time: 0.233802 Aug 31 01:23:47.694738 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 84/169] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:47 2022] GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:48.715369 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-7ab4d991-3e5a-411e-bb9c-1552eaab43ed tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:48.715981 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-7ab4d991-3e5a-411e-bb9c-1552eaab43ed tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: ee6ca45e-29c7-4af8-8aef-72134f23292c] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:48.725968 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7ab4d991-3e5a-411e-bb9c-1552eaab43ed tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:48.732049 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7ab4d991-3e5a-411e-bb9c-1552eaab43ed tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:48.732049 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7ab4d991-3e5a-411e-bb9c-1552eaab43ed tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:48.732049 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7ab4d991-3e5a-411e-bb9c-1552eaab43ed tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:48.732049 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7ab4d991-3e5a-411e-bb9c-1552eaab43ed tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:48.732596 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7ab4d991-3e5a-411e-bb9c-1552eaab43ed tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:48.926952 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-7ab4d991-3e5a-411e-bb9c-1552eaab43ed tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:48.935896 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-7ab4d991-3e5a-411e-bb9c-1552eaab43ed tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c" status: 200 len: 1522 microversion: 2.1 time: 0.224304 Aug 31 01:23:48.936589 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 86/170] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:48 2022] GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:49.958407 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-4e0ce688-2e64-4dd6-bb4f-d54accc3a9e6 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:49.959612 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-4e0ce688-2e64-4dd6-bb4f-d54accc3a9e6 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: ee6ca45e-29c7-4af8-8aef-72134f23292c] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:49.966725 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4e0ce688-2e64-4dd6-bb4f-d54accc3a9e6 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:49.967220 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4e0ce688-2e64-4dd6-bb4f-d54accc3a9e6 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:49.968669 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4e0ce688-2e64-4dd6-bb4f-d54accc3a9e6 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:49.969424 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4e0ce688-2e64-4dd6-bb4f-d54accc3a9e6 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:49.969960 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4e0ce688-2e64-4dd6-bb4f-d54accc3a9e6 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:49.970412 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4e0ce688-2e64-4dd6-bb4f-d54accc3a9e6 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:50.200532 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-4e0ce688-2e64-4dd6-bb4f-d54accc3a9e6 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:50.210323 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-4e0ce688-2e64-4dd6-bb4f-d54accc3a9e6 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c" status: 200 len: 1522 microversion: 2.1 time: 0.256718 Aug 31 01:23:50.211331 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 85/171] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:49 2022] GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:50.390775 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-438f969b-ff34-459e-a377-4fac4b841672 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1170723725", "imageRef": "ed6d3236-defa-4ccf-90ba-343c0d0ad58e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2d97e458-c7f0-41e8-8974-7a68b9809489"}], "security_groups": [{"name": "tempest-securitygroup--241354219"}], "key_name": "tempest-keypair-1661791226", "user_data": "}} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:23:50.535072 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.network.neutron [None req-438f969b-ff34-459e-a377-4fac4b841672 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] validate_networks() for [('2d97e458-c7f0-41e8-8974-7a68b9809489', None, None, None, None, None)] {{(pid=121026) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 01:23:51.239601 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-3225c1e7-cabc-4d22-9a04-1095e9ddd37b tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:51.240401 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-3225c1e7-cabc-4d22-9a04-1095e9ddd37b tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: ee6ca45e-29c7-4af8-8aef-72134f23292c] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:51.245593 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:23:51.247712 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3225c1e7-cabc-4d22-9a04-1095e9ddd37b tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:51.248433 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3225c1e7-cabc-4d22-9a04-1095e9ddd37b tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:51.249019 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3225c1e7-cabc-4d22-9a04-1095e9ddd37b tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:51.249853 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3225c1e7-cabc-4d22-9a04-1095e9ddd37b tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:51.250500 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3225c1e7-cabc-4d22-9a04-1095e9ddd37b tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:51.251137 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3225c1e7-cabc-4d22-9a04-1095e9ddd37b tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:51.266263 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.virt.hardware [None req-438f969b-ff34-459e-a377-4fac4b841672 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Flavor limits 0:0:0 {{(pid=121026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 01:23:51.266810 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.virt.hardware [None req-438f969b-ff34-459e-a377-4fac4b841672 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Image limits 0:0:0 {{(pid=121026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 01:23:51.267303 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.virt.hardware [None req-438f969b-ff34-459e-a377-4fac4b841672 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Flavor pref 0:0:0 {{(pid=121026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 01:23:51.267712 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.virt.hardware [None req-438f969b-ff34-459e-a377-4fac4b841672 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Image pref 0:0:0 {{(pid=121026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 01:23:51.268145 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.virt.hardware [None req-438f969b-ff34-459e-a377-4fac4b841672 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 01:23:51.277312 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-438f969b-ff34-459e-a377-4fac4b841672 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:51.278094 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-438f969b-ff34-459e-a377-4fac4b841672 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:51.278687 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-438f969b-ff34-459e-a377-4fac4b841672 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:51.279677 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-438f969b-ff34-459e-a377-4fac4b841672 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:51.280282 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-438f969b-ff34-459e-a377-4fac4b841672 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:51.280906 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-438f969b-ff34-459e-a377-4fac4b841672 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:51.305858 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.quota [None req-438f969b-ff34-459e-a377-4fac4b841672 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Getting quotas for project fb863f706c3846db958c9b7fe367c3f5. Resources: {'instances', 'cores', 'ram'} {{(pid=121026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 01:23:51.310226 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.quota [None req-438f969b-ff34-459e-a377-4fac4b841672 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Getting quotas for user 1cc3db55df284cd39f28fcfefc619fda and project fb863f706c3846db958c9b7fe367c3f5. Resources: {'instances', 'cores', 'ram'} {{(pid=121026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 01:23:51.322555 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-438f969b-ff34-459e-a377-4fac4b841672 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Going to run 1 instances... {{(pid=121026) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 01:23:51.324853 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-438f969b-ff34-459e-a377-4fac4b841672 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ed6d3236-defa-4ccf-90ba-343c0d0ad58e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121026) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 01:23:51.403195 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-3225c1e7-cabc-4d22-9a04-1095e9ddd37b tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:51.416513 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-3225c1e7-cabc-4d22-9a04-1095e9ddd37b tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c" status: 200 len: 1522 microversion: 2.1 time: 0.178945 Aug 31 01:23:51.416513 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 86/172] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:51 2022] GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:23:51.450355 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-438f969b-ff34-459e-a377-4fac4b841672 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.064105 Aug 31 01:23:51.451060 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 87/173] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 31 01:23:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 1066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 01:23:51.462487 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-1c2c7efc-4c49-4221-b87a-4a50b22f46e1 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:51.463222 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-1c2c7efc-4c49-4221-b87a-4a50b22f46e1 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:51.536403 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-1c2c7efc-4c49-4221-b87a-4a50b22f46e1 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:51.543755 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-1c2c7efc-4c49-4221-b87a-4a50b22f46e1 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1238 microversion: 2.1 time: 0.085099 Aug 31 01:23:51.544566 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 87/174] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:51 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1238 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:52.437296 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-ff0ddab6-d734-46e2-b7b2-cdac4734a313 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:52.438149 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-ff0ddab6-d734-46e2-b7b2-cdac4734a313 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: ee6ca45e-29c7-4af8-8aef-72134f23292c] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:52.449256 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ff0ddab6-d734-46e2-b7b2-cdac4734a313 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:52.449754 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ff0ddab6-d734-46e2-b7b2-cdac4734a313 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:52.450199 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ff0ddab6-d734-46e2-b7b2-cdac4734a313 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:52.451141 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ff0ddab6-d734-46e2-b7b2-cdac4734a313 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:52.451664 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ff0ddab6-d734-46e2-b7b2-cdac4734a313 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:52.452002 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ff0ddab6-d734-46e2-b7b2-cdac4734a313 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:52.581411 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-9285e14b-9507-4a42-a4c8-22f81a123242 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:52.581411 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-9285e14b-9507-4a42-a4c8-22f81a123242 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:52.604305 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-ff0ddab6-d734-46e2-b7b2-cdac4734a313 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:52.613355 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-ff0ddab6-d734-46e2-b7b2-cdac4734a313 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c" status: 200 len: 1522 microversion: 2.1 time: 0.181311 Aug 31 01:23:52.614611 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 88/175] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:52 2022] GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:52.649912 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-9285e14b-9507-4a42-a4c8-22f81a123242 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:52.657818 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-9285e14b-9507-4a42-a4c8-22f81a123242 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1238 microversion: 2.1 time: 0.096282 Aug 31 01:23:52.658564 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 88/176] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:52 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1238 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:23:53.634292 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-abb3b9d6-3a4b-4ea6-8f8d-257021482c6f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:53.636190 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-abb3b9d6-3a4b-4ea6-8f8d-257021482c6f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: ee6ca45e-29c7-4af8-8aef-72134f23292c] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:53.642946 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-abb3b9d6-3a4b-4ea6-8f8d-257021482c6f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:53.643862 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-abb3b9d6-3a4b-4ea6-8f8d-257021482c6f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:53.645188 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-abb3b9d6-3a4b-4ea6-8f8d-257021482c6f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:53.646066 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-abb3b9d6-3a4b-4ea6-8f8d-257021482c6f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:53.646782 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-abb3b9d6-3a4b-4ea6-8f8d-257021482c6f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:53.655369 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-abb3b9d6-3a4b-4ea6-8f8d-257021482c6f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:53.678517 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-b46e1f43-3e36-43f2-8d16-fd14787b9079 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:53.679121 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-b46e1f43-3e36-43f2-8d16-fd14787b9079 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:53.688467 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b46e1f43-3e36-43f2-8d16-fd14787b9079 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:53.688981 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b46e1f43-3e36-43f2-8d16-fd14787b9079 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:53.689408 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b46e1f43-3e36-43f2-8d16-fd14787b9079 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:53.690104 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b46e1f43-3e36-43f2-8d16-fd14787b9079 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:53.696127 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b46e1f43-3e36-43f2-8d16-fd14787b9079 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:53.696127 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b46e1f43-3e36-43f2-8d16-fd14787b9079 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:53.806006 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-b46e1f43-3e36-43f2-8d16-fd14787b9079 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:53.822697 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-b46e1f43-3e36-43f2-8d16-fd14787b9079 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1290 microversion: 2.1 time: 0.141043 Aug 31 01:23:53.824125 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 89/177] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:53 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1290 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:53.914616 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-abb3b9d6-3a4b-4ea6-8f8d-257021482c6f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:53.924549 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-abb3b9d6-3a4b-4ea6-8f8d-257021482c6f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c" status: 200 len: 1522 microversion: 2.1 time: 0.294039 Aug 31 01:23:53.927097 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 89/178] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:53 2022] GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:54.850295 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-52e8559d-40c7-4a91-950e-51ec2f933d83 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:54.851794 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-52e8559d-40c7-4a91-950e-51ec2f933d83 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:54.864202 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-52e8559d-40c7-4a91-950e-51ec2f933d83 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:54.864689 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-52e8559d-40c7-4a91-950e-51ec2f933d83 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:54.865435 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-52e8559d-40c7-4a91-950e-51ec2f933d83 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:54.866344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-52e8559d-40c7-4a91-950e-51ec2f933d83 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:54.866952 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-52e8559d-40c7-4a91-950e-51ec2f933d83 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:54.867485 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-52e8559d-40c7-4a91-950e-51ec2f933d83 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:54.947156 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-a2180b03-c5ce-46d8-b8ea-8f4e2ac85c0f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:54.947858 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-a2180b03-c5ce-46d8-b8ea-8f4e2ac85c0f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: ee6ca45e-29c7-4af8-8aef-72134f23292c] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:54.952622 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-52e8559d-40c7-4a91-950e-51ec2f933d83 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:54.956210 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a2180b03-c5ce-46d8-b8ea-8f4e2ac85c0f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:54.957382 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a2180b03-c5ce-46d8-b8ea-8f4e2ac85c0f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:54.957927 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a2180b03-c5ce-46d8-b8ea-8f4e2ac85c0f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:54.958759 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a2180b03-c5ce-46d8-b8ea-8f4e2ac85c0f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:54.959270 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a2180b03-c5ce-46d8-b8ea-8f4e2ac85c0f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:54.959836 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a2180b03-c5ce-46d8-b8ea-8f4e2ac85c0f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:54.963519 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-52e8559d-40c7-4a91-950e-51ec2f933d83 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1308 microversion: 2.1 time: 0.116791 Aug 31 01:23:54.964602 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 90/179] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:54 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1308 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:55.225144 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-a2180b03-c5ce-46d8-b8ea-8f4e2ac85c0f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:55.232563 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-a2180b03-c5ce-46d8-b8ea-8f4e2ac85c0f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c" status: 200 len: 1522 microversion: 2.1 time: 0.289176 Aug 31 01:23:55.237001 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 90/180] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:54 2022] GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:56.189682 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-71d6ddae-396e-4a0d-b1f5-702beefc47f2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:56.189682 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-71d6ddae-396e-4a0d-b1f5-702beefc47f2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:56.189682 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-71d6ddae-396e-4a0d-b1f5-702beefc47f2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:56.189682 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-71d6ddae-396e-4a0d-b1f5-702beefc47f2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:56.192796 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-71d6ddae-396e-4a0d-b1f5-702beefc47f2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:56.192796 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-71d6ddae-396e-4a0d-b1f5-702beefc47f2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:56.192796 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-71d6ddae-396e-4a0d-b1f5-702beefc47f2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:56.192796 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-71d6ddae-396e-4a0d-b1f5-702beefc47f2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:56.193059 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-71d6ddae-396e-4a0d-b1f5-702beefc47f2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:56.198043 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-71d6ddae-396e-4a0d-b1f5-702beefc47f2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1363 microversion: 2.1 time: 0.216844 Aug 31 01:23:56.198622 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 91/181] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:55 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:56.254857 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-20dd7618-0658-458a-bf24-9ac8683d9404 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:56.255517 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-20dd7618-0658-458a-bf24-9ac8683d9404 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: ee6ca45e-29c7-4af8-8aef-72134f23292c] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:56.258171 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:23:56.263551 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-20dd7618-0658-458a-bf24-9ac8683d9404 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:56.264264 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-20dd7618-0658-458a-bf24-9ac8683d9404 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:56.264782 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-20dd7618-0658-458a-bf24-9ac8683d9404 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:56.265533 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-20dd7618-0658-458a-bf24-9ac8683d9404 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:56.265975 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-20dd7618-0658-458a-bf24-9ac8683d9404 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:56.266421 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-20dd7618-0658-458a-bf24-9ac8683d9404 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:56.472243 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-20dd7618-0658-458a-bf24-9ac8683d9404 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:56.483352 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-20dd7618-0658-458a-bf24-9ac8683d9404 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c" status: 200 len: 1522 microversion: 2.1 time: 0.233039 Aug 31 01:23:56.500752 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 91/182] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:56 2022] GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:56.752314 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-bb562bfa-2666-4a81-87ff-e5c4b510c9ba req-1a38656e-0d25-4f07-845e-aca9d7ad9eb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "368bac0a-39c9-4f1e-99f9-84223e7de06b", "tag": "51441d6e-84dd-48a3-bd25-fade9ebd6634"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:23:56.762515 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-bb562bfa-2666-4a81-87ff-e5c4b510c9ba req-1a38656e-0d25-4f07-845e-aca9d7ad9eb1 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:56.762985 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-bb562bfa-2666-4a81-87ff-e5c4b510c9ba req-1a38656e-0d25-4f07-845e-aca9d7ad9eb1 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:56.763411 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-bb562bfa-2666-4a81-87ff-e5c4b510c9ba req-1a38656e-0d25-4f07-845e-aca9d7ad9eb1 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:56.778712 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-bb562bfa-2666-4a81-87ff-e5c4b510c9ba req-1a38656e-0d25-4f07-845e-aca9d7ad9eb1 service nova] Creating event network-changed:51441d6e-84dd-48a3-bd25-fade9ebd6634 for instance 368bac0a-39c9-4f1e-99f9-84223e7de06b on hv-cinder-85528 Aug 31 01:23:56.789093 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-bb562bfa-2666-4a81-87ff-e5c4b510c9ba req-1a38656e-0d25-4f07-845e-aca9d7ad9eb1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040239 Aug 31 01:23:56.789979 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 92/183] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:23:57.226079 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-308128d0-927c-4a49-926c-91e41bdf9615 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:57.226799 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-308128d0-927c-4a49-926c-91e41bdf9615 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:57.233566 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-308128d0-927c-4a49-926c-91e41bdf9615 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:57.234057 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-308128d0-927c-4a49-926c-91e41bdf9615 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:57.234612 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-308128d0-927c-4a49-926c-91e41bdf9615 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:57.235316 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-308128d0-927c-4a49-926c-91e41bdf9615 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:57.235767 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-308128d0-927c-4a49-926c-91e41bdf9615 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:57.236187 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-308128d0-927c-4a49-926c-91e41bdf9615 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:57.369513 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-308128d0-927c-4a49-926c-91e41bdf9615 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:57.377147 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-308128d0-927c-4a49-926c-91e41bdf9615 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1363 microversion: 2.1 time: 0.155319 Aug 31 01:23:57.377709 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 92/184] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:57 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:57.519743 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-0e976c78-eaf5-4444-88ff-d4143c572702 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:57.520433 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-0e976c78-eaf5-4444-88ff-d4143c572702 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: ee6ca45e-29c7-4af8-8aef-72134f23292c] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:57.526808 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0e976c78-eaf5-4444-88ff-d4143c572702 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:57.527228 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0e976c78-eaf5-4444-88ff-d4143c572702 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:57.527656 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0e976c78-eaf5-4444-88ff-d4143c572702 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:57.528330 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0e976c78-eaf5-4444-88ff-d4143c572702 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:57.528801 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0e976c78-eaf5-4444-88ff-d4143c572702 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:57.529220 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0e976c78-eaf5-4444-88ff-d4143c572702 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:57.673763 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-0e976c78-eaf5-4444-88ff-d4143c572702 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:57.682829 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-0e976c78-eaf5-4444-88ff-d4143c572702 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c" status: 200 len: 1522 microversion: 2.1 time: 0.167811 Aug 31 01:23:57.683399 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 93/185] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:57 2022] GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:58.397987 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-6e52b748-977f-464c-8102-f3c528fb9706 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:58.398515 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-6e52b748-977f-464c-8102-f3c528fb9706 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:58.405765 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6e52b748-977f-464c-8102-f3c528fb9706 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:58.406244 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6e52b748-977f-464c-8102-f3c528fb9706 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:58.406702 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6e52b748-977f-464c-8102-f3c528fb9706 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:58.407382 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6e52b748-977f-464c-8102-f3c528fb9706 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:58.407830 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6e52b748-977f-464c-8102-f3c528fb9706 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:58.408246 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6e52b748-977f-464c-8102-f3c528fb9706 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:58.548279 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-6e52b748-977f-464c-8102-f3c528fb9706 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:58.556821 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-6e52b748-977f-464c-8102-f3c528fb9706 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1363 microversion: 2.1 time: 0.162687 Aug 31 01:23:58.557398 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 93/186] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:58 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:58.703383 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-4a29c618-bf35-45ce-b07b-5e493a3ad31e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:58.704269 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-4a29c618-bf35-45ce-b07b-5e493a3ad31e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: ee6ca45e-29c7-4af8-8aef-72134f23292c] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:58.710539 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4a29c618-bf35-45ce-b07b-5e493a3ad31e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:58.710835 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4a29c618-bf35-45ce-b07b-5e493a3ad31e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:58.711308 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4a29c618-bf35-45ce-b07b-5e493a3ad31e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:58.711983 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4a29c618-bf35-45ce-b07b-5e493a3ad31e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:58.712423 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4a29c618-bf35-45ce-b07b-5e493a3ad31e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:58.712860 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4a29c618-bf35-45ce-b07b-5e493a3ad31e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:58.843848 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-4a29c618-bf35-45ce-b07b-5e493a3ad31e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:58.852567 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-4a29c618-bf35-45ce-b07b-5e493a3ad31e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c" status: 200 len: 1522 microversion: 2.1 time: 0.153125 Aug 31 01:23:58.853170 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 94/187] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:58 2022] GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:59.577364 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-2d26c634-9b7b-47f6-b543-20ff7d322611 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:59.577951 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-2d26c634-9b7b-47f6-b543-20ff7d322611 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:59.585171 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-2d26c634-9b7b-47f6-b543-20ff7d322611 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:59.585651 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-2d26c634-9b7b-47f6-b543-20ff7d322611 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:59.586083 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-2d26c634-9b7b-47f6-b543-20ff7d322611 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:59.586772 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-2d26c634-9b7b-47f6-b543-20ff7d322611 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:59.587224 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-2d26c634-9b7b-47f6-b543-20ff7d322611 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:59.587647 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-2d26c634-9b7b-47f6-b543-20ff7d322611 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:59.723700 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-2d26c634-9b7b-47f6-b543-20ff7d322611 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:23:59.731325 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-2d26c634-9b7b-47f6-b543-20ff7d322611 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1363 microversion: 2.1 time: 0.157851 Aug 31 01:23:59.731978 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 94/188] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:59 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:23:59.874761 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-54d5ab23-bbe4-4feb-ba2d-696737625288 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:23:59.875371 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-54d5ab23-bbe4-4feb-ba2d-696737625288 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: ee6ca45e-29c7-4af8-8aef-72134f23292c] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:23:59.882589 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-54d5ab23-bbe4-4feb-ba2d-696737625288 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:59.884037 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-54d5ab23-bbe4-4feb-ba2d-696737625288 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:59.884037 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-54d5ab23-bbe4-4feb-ba2d-696737625288 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:23:59.884233 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-54d5ab23-bbe4-4feb-ba2d-696737625288 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:23:59.884642 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-54d5ab23-bbe4-4feb-ba2d-696737625288 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:23:59.885095 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-54d5ab23-bbe4-4feb-ba2d-696737625288 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:00.022449 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-54d5ab23-bbe4-4feb-ba2d-696737625288 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:00.030164 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-54d5ab23-bbe4-4feb-ba2d-696737625288 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c" status: 200 len: 1522 microversion: 2.1 time: 0.159311 Aug 31 01:24:00.030671 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 95/189] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:23:59 2022] GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:00.751899 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-f88cb646-7882-4669-a110-521f4430384b tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:00.752509 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-f88cb646-7882-4669-a110-521f4430384b tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:00.759356 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f88cb646-7882-4669-a110-521f4430384b tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:00.759880 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f88cb646-7882-4669-a110-521f4430384b tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:00.760323 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f88cb646-7882-4669-a110-521f4430384b tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:00.761066 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f88cb646-7882-4669-a110-521f4430384b tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:00.761520 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f88cb646-7882-4669-a110-521f4430384b tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:00.761970 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f88cb646-7882-4669-a110-521f4430384b tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:00.895931 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-f88cb646-7882-4669-a110-521f4430384b tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:00.904073 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-f88cb646-7882-4669-a110-521f4430384b tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1363 microversion: 2.1 time: 0.155950 Aug 31 01:24:00.905011 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 95/190] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:00 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:01.051319 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-b4ff1de0-a137-44e3-920d-e8e27824addc tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:01.051963 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-b4ff1de0-a137-44e3-920d-e8e27824addc tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: ee6ca45e-29c7-4af8-8aef-72134f23292c] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:01.057826 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b4ff1de0-a137-44e3-920d-e8e27824addc tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:01.058312 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b4ff1de0-a137-44e3-920d-e8e27824addc tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:01.058748 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b4ff1de0-a137-44e3-920d-e8e27824addc tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:01.059431 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b4ff1de0-a137-44e3-920d-e8e27824addc tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:01.059883 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b4ff1de0-a137-44e3-920d-e8e27824addc tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:01.060305 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b4ff1de0-a137-44e3-920d-e8e27824addc tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:01.189880 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-b4ff1de0-a137-44e3-920d-e8e27824addc tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:01.197938 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-b4ff1de0-a137-44e3-920d-e8e27824addc tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c" status: 200 len: 1522 microversion: 2.1 time: 0.150191 Aug 31 01:24:01.198508 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 96/191] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:01 2022] GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:01.925298 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-c01fae6d-2ba3-4d21-bed5-4445ce5827e3 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:01.925908 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-c01fae6d-2ba3-4d21-bed5-4445ce5827e3 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:01.928278 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell0:SELECT=2 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:24:01.928963 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell0:SELECT=10 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:24:01.934094 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c01fae6d-2ba3-4d21-bed5-4445ce5827e3 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:01.934570 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c01fae6d-2ba3-4d21-bed5-4445ce5827e3 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:01.934999 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c01fae6d-2ba3-4d21-bed5-4445ce5827e3 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:01.935675 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c01fae6d-2ba3-4d21-bed5-4445ce5827e3 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:01.936120 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c01fae6d-2ba3-4d21-bed5-4445ce5827e3 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:01.936537 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c01fae6d-2ba3-4d21-bed5-4445ce5827e3 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:01.955165 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:24:02.064225 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-c01fae6d-2ba3-4d21-bed5-4445ce5827e3 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:02.073012 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-c01fae6d-2ba3-4d21-bed5-4445ce5827e3 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1363 microversion: 2.1 time: 0.151554 Aug 31 01:24:02.073579 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 96/192] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:01 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:02.218860 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-5e4f7fea-0d91-49b9-bedb-3f004f0d500e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:02.219578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-5e4f7fea-0d91-49b9-bedb-3f004f0d500e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: ee6ca45e-29c7-4af8-8aef-72134f23292c] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:02.227828 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5e4f7fea-0d91-49b9-bedb-3f004f0d500e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:02.228302 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5e4f7fea-0d91-49b9-bedb-3f004f0d500e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:02.228780 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5e4f7fea-0d91-49b9-bedb-3f004f0d500e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:02.229485 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5e4f7fea-0d91-49b9-bedb-3f004f0d500e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:02.229926 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5e4f7fea-0d91-49b9-bedb-3f004f0d500e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:02.230340 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5e4f7fea-0d91-49b9-bedb-3f004f0d500e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:02.359074 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-5e4f7fea-0d91-49b9-bedb-3f004f0d500e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:02.367258 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-5e4f7fea-0d91-49b9-bedb-3f004f0d500e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c" status: 200 len: 1522 microversion: 2.1 time: 0.152238 Aug 31 01:24:02.367814 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 97/193] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:02 2022] GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:03.094172 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-0add5f66-20c7-4315-8b16-5ac931883f75 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:03.094795 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-0add5f66-20c7-4315-8b16-5ac931883f75 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:03.101666 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0add5f66-20c7-4315-8b16-5ac931883f75 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:03.102153 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0add5f66-20c7-4315-8b16-5ac931883f75 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:03.102590 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0add5f66-20c7-4315-8b16-5ac931883f75 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:03.103285 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0add5f66-20c7-4315-8b16-5ac931883f75 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:03.103740 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0add5f66-20c7-4315-8b16-5ac931883f75 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:03.104177 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0add5f66-20c7-4315-8b16-5ac931883f75 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:03.246476 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-0add5f66-20c7-4315-8b16-5ac931883f75 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:03.254216 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-0add5f66-20c7-4315-8b16-5ac931883f75 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1363 microversion: 2.1 time: 0.164238 Aug 31 01:24:03.255387 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 97/194] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:03 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:03.388897 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-1194d0f9-3674-4875-ba77-46019970dd54 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:03.389465 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-1194d0f9-3674-4875-ba77-46019970dd54 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: ee6ca45e-29c7-4af8-8aef-72134f23292c] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:03.391400 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell0:SELECT=4 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:24:03.396092 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1194d0f9-3674-4875-ba77-46019970dd54 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:03.396574 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1194d0f9-3674-4875-ba77-46019970dd54 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:03.397031 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1194d0f9-3674-4875-ba77-46019970dd54 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:03.397711 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1194d0f9-3674-4875-ba77-46019970dd54 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:03.398213 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1194d0f9-3674-4875-ba77-46019970dd54 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:03.398629 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1194d0f9-3674-4875-ba77-46019970dd54 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:03.531736 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-1194d0f9-3674-4875-ba77-46019970dd54 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:03.539690 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-1194d0f9-3674-4875-ba77-46019970dd54 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c" status: 200 len: 1522 microversion: 2.1 time: 0.155406 Aug 31 01:24:03.543522 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 98/195] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:03 2022] GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:04.275702 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-3bbd3651-608d-4e5f-9ae6-e81d2ab538c3 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:04.276310 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-3bbd3651-608d-4e5f-9ae6-e81d2ab538c3 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:04.282728 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3bbd3651-608d-4e5f-9ae6-e81d2ab538c3 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:04.283207 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3bbd3651-608d-4e5f-9ae6-e81d2ab538c3 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:04.283688 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3bbd3651-608d-4e5f-9ae6-e81d2ab538c3 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:04.284322 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3bbd3651-608d-4e5f-9ae6-e81d2ab538c3 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:04.284840 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3bbd3651-608d-4e5f-9ae6-e81d2ab538c3 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:04.285312 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3bbd3651-608d-4e5f-9ae6-e81d2ab538c3 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:04.494491 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-3bbd3651-608d-4e5f-9ae6-e81d2ab538c3 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:04.501656 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-3bbd3651-608d-4e5f-9ae6-e81d2ab538c3 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1363 microversion: 2.1 time: 0.229830 Aug 31 01:24:04.502230 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 98/196] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:04 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:04.561715 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-d06f4c44-7a37-4b75-aa57-6b2561f7270f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:04.562233 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-d06f4c44-7a37-4b75-aa57-6b2561f7270f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: ee6ca45e-29c7-4af8-8aef-72134f23292c] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:04.568991 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d06f4c44-7a37-4b75-aa57-6b2561f7270f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:04.569475 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d06f4c44-7a37-4b75-aa57-6b2561f7270f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:04.569903 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d06f4c44-7a37-4b75-aa57-6b2561f7270f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:04.570593 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d06f4c44-7a37-4b75-aa57-6b2561f7270f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:04.571039 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d06f4c44-7a37-4b75-aa57-6b2561f7270f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:04.571456 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d06f4c44-7a37-4b75-aa57-6b2561f7270f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:04.718662 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-d06f4c44-7a37-4b75-aa57-6b2561f7270f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:04.727366 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-d06f4c44-7a37-4b75-aa57-6b2561f7270f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c" status: 200 len: 1522 microversion: 2.1 time: 0.170382 Aug 31 01:24:04.727949 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 99/197] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:04 2022] GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:05.474618 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-ed93f357-0762-48d8-a42c-e6441b9b744b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:05.475163 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-ed93f357-0762-48d8-a42c-e6441b9b744b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 8ce564c8-7a17-4de1-96b9-3737fca73840] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:05.481987 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ed93f357-0762-48d8-a42c-e6441b9b744b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:05.482470 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ed93f357-0762-48d8-a42c-e6441b9b744b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:05.482905 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ed93f357-0762-48d8-a42c-e6441b9b744b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:05.483606 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ed93f357-0762-48d8-a42c-e6441b9b744b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:05.484056 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ed93f357-0762-48d8-a42c-e6441b9b744b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:05.484471 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ed93f357-0762-48d8-a42c-e6441b9b744b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:05.508495 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-ed93f357-0762-48d8-a42c-e6441b9b744b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840/ips" status: 200 len: 148 microversion: 2.1 time: 0.038346 Aug 31 01:24:05.509241 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 99/198] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Aug 31 01:24:05 2022] GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840/ips => generated 148 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:24:05.524702 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-8f443701-376d-413b-9d71-115a2a8904c2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:05.525387 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-8f443701-376d-413b-9d71-115a2a8904c2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:05.531808 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8f443701-376d-413b-9d71-115a2a8904c2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:05.532365 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8f443701-376d-413b-9d71-115a2a8904c2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:05.532907 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8f443701-376d-413b-9d71-115a2a8904c2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:05.533622 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8f443701-376d-413b-9d71-115a2a8904c2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:05.534097 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8f443701-376d-413b-9d71-115a2a8904c2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:05.534520 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8f443701-376d-413b-9d71-115a2a8904c2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:05.675519 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-8f443701-376d-413b-9d71-115a2a8904c2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:05.683161 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-8f443701-376d-413b-9d71-115a2a8904c2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1363 microversion: 2.1 time: 0.164332 Aug 31 01:24:05.683723 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 100/199] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:05 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:05.749191 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-a8390016-07b2-45e9-80a0-78a15780acad tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:05.749803 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-a8390016-07b2-45e9-80a0-78a15780acad tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: ee6ca45e-29c7-4af8-8aef-72134f23292c] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:05.755760 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a8390016-07b2-45e9-80a0-78a15780acad tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:05.756236 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a8390016-07b2-45e9-80a0-78a15780acad tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:05.756670 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a8390016-07b2-45e9-80a0-78a15780acad tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:05.757393 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a8390016-07b2-45e9-80a0-78a15780acad tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:05.757844 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a8390016-07b2-45e9-80a0-78a15780acad tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:05.758261 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a8390016-07b2-45e9-80a0-78a15780acad tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:05.895982 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-a8390016-07b2-45e9-80a0-78a15780acad tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:05.912799 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-a8390016-07b2-45e9-80a0-78a15780acad tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c" status: 200 len: 1522 microversion: 2.1 time: 0.159300 Aug 31 01:24:05.912799 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 100/200] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:05 2022] GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:06.703724 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-b16946dd-d083-43b5-8b17-6dc1dc823279 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:06.704578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-b16946dd-d083-43b5-8b17-6dc1dc823279 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:06.711224 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b16946dd-d083-43b5-8b17-6dc1dc823279 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:06.711871 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b16946dd-d083-43b5-8b17-6dc1dc823279 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:06.712303 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b16946dd-d083-43b5-8b17-6dc1dc823279 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:06.713145 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b16946dd-d083-43b5-8b17-6dc1dc823279 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:06.713604 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b16946dd-d083-43b5-8b17-6dc1dc823279 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:06.714023 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b16946dd-d083-43b5-8b17-6dc1dc823279 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:06.925586 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-bfe4e3e5-d0c5-4f8f-a93a-fbf7e7dc41bb tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:06.926766 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-bfe4e3e5-d0c5-4f8f-a93a-fbf7e7dc41bb tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: ee6ca45e-29c7-4af8-8aef-72134f23292c] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:06.933135 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-bfe4e3e5-d0c5-4f8f-a93a-fbf7e7dc41bb tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:06.933622 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-bfe4e3e5-d0c5-4f8f-a93a-fbf7e7dc41bb tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:06.934075 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-bfe4e3e5-d0c5-4f8f-a93a-fbf7e7dc41bb tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:06.934781 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-bfe4e3e5-d0c5-4f8f-a93a-fbf7e7dc41bb tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:06.935283 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-bfe4e3e5-d0c5-4f8f-a93a-fbf7e7dc41bb tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:06.935677 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-bfe4e3e5-d0c5-4f8f-a93a-fbf7e7dc41bb tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:06.939807 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-b16946dd-d083-43b5-8b17-6dc1dc823279 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:06.947698 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-b16946dd-d083-43b5-8b17-6dc1dc823279 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1363 microversion: 2.1 time: 0.248084 Aug 31 01:24:06.948669 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 101/201] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:06 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:07.076134 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-bfe4e3e5-d0c5-4f8f-a93a-fbf7e7dc41bb tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:07.084533 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-bfe4e3e5-d0c5-4f8f-a93a-fbf7e7dc41bb tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c" status: 200 len: 1522 microversion: 2.1 time: 0.162946 Aug 31 01:24:07.085123 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 101/202] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:06 2022] GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:24:07.969386 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-4fa89abf-2307-45db-802c-4dc3dcbe33f1 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:07.970020 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-4fa89abf-2307-45db-802c-4dc3dcbe33f1 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:07.975915 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4fa89abf-2307-45db-802c-4dc3dcbe33f1 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:07.976399 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4fa89abf-2307-45db-802c-4dc3dcbe33f1 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:07.976904 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4fa89abf-2307-45db-802c-4dc3dcbe33f1 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:07.977589 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4fa89abf-2307-45db-802c-4dc3dcbe33f1 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:07.978043 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4fa89abf-2307-45db-802c-4dc3dcbe33f1 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:07.978463 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4fa89abf-2307-45db-802c-4dc3dcbe33f1 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:07.982324 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell1:SELECT=100 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:24:08.105123 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-83c13059-731e-4174-9353-51dcd9798613 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:08.105869 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-83c13059-731e-4174-9353-51dcd9798613 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: ee6ca45e-29c7-4af8-8aef-72134f23292c] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:08.108013 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-4fa89abf-2307-45db-802c-4dc3dcbe33f1 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:08.112455 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-83c13059-731e-4174-9353-51dcd9798613 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:08.112969 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-83c13059-731e-4174-9353-51dcd9798613 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:08.113401 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-83c13059-731e-4174-9353-51dcd9798613 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:08.116974 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-83c13059-731e-4174-9353-51dcd9798613 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:08.116974 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-83c13059-731e-4174-9353-51dcd9798613 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:08.116974 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-83c13059-731e-4174-9353-51dcd9798613 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:08.117261 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-4fa89abf-2307-45db-802c-4dc3dcbe33f1 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1363 microversion: 2.1 time: 0.150926 Aug 31 01:24:08.117261 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 102/203] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:07 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:08.253194 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-83c13059-731e-4174-9353-51dcd9798613 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:08.260915 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-83c13059-731e-4174-9353-51dcd9798613 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c" status: 200 len: 1522 microversion: 2.1 time: 0.159736 Aug 31 01:24:08.261517 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 102/204] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:08 2022] GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:24:09.137660 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-bb1f322a-7872-4120-ade7-fbc55cadee3e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:09.138375 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-bb1f322a-7872-4120-ade7-fbc55cadee3e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:09.145388 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-bb1f322a-7872-4120-ade7-fbc55cadee3e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:09.146131 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-bb1f322a-7872-4120-ade7-fbc55cadee3e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:09.146712 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-bb1f322a-7872-4120-ade7-fbc55cadee3e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:09.147696 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-bb1f322a-7872-4120-ade7-fbc55cadee3e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:09.148146 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-bb1f322a-7872-4120-ade7-fbc55cadee3e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:09.148562 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-bb1f322a-7872-4120-ade7-fbc55cadee3e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:09.284823 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-7e496360-a360-499d-89fd-169b90c3c9ba tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:09.286163 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-7e496360-a360-499d-89fd-169b90c3c9ba tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: ee6ca45e-29c7-4af8-8aef-72134f23292c] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:09.292697 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7e496360-a360-499d-89fd-169b90c3c9ba tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:09.293229 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7e496360-a360-499d-89fd-169b90c3c9ba tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:09.293696 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7e496360-a360-499d-89fd-169b90c3c9ba tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:09.294401 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7e496360-a360-499d-89fd-169b90c3c9ba tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:09.294878 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7e496360-a360-499d-89fd-169b90c3c9ba tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:09.295312 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7e496360-a360-499d-89fd-169b90c3c9ba tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:09.299498 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-bb1f322a-7872-4120-ade7-fbc55cadee3e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:09.307966 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-bb1f322a-7872-4120-ade7-fbc55cadee3e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1363 microversion: 2.1 time: 0.174602 Aug 31 01:24:09.308541 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 103/205] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:09 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:09.435535 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-7e496360-a360-499d-89fd-169b90c3c9ba tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:09.444633 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-7e496360-a360-499d-89fd-169b90c3c9ba tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c" status: 200 len: 1522 microversion: 2.1 time: 0.163646 Aug 31 01:24:09.457841 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 103/206] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:09 2022] GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:09.469314 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-d14423a4-000e-4169-841d-160417fa7154 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65d3391e-c61d-4019-baea-6bda7d3d4d7d"}} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:24:09.471768 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-d14423a4-000e-4169-841d-160417fa7154 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 8ce564c8-7a17-4de1-96b9-3737fca73840] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:09.478559 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d14423a4-000e-4169-841d-160417fa7154 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:09.479182 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d14423a4-000e-4169-841d-160417fa7154 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:09.479744 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d14423a4-000e-4169-841d-160417fa7154 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:09.480807 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d14423a4-000e-4169-841d-160417fa7154 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:09.481360 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d14423a4-000e-4169-841d-160417fa7154 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:09.482006 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d14423a4-000e-4169-841d-160417fa7154 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:10.329805 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-f4679277-11cd-460b-b889-7052d4f4561a tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:10.330336 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-f4679277-11cd-460b-b889-7052d4f4561a tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:10.337052 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f4679277-11cd-460b-b889-7052d4f4561a tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:10.337535 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f4679277-11cd-460b-b889-7052d4f4561a tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:10.337972 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f4679277-11cd-460b-b889-7052d4f4561a tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:10.338662 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f4679277-11cd-460b-b889-7052d4f4561a tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:10.339117 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f4679277-11cd-460b-b889-7052d4f4561a tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:10.339545 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f4679277-11cd-460b-b889-7052d4f4561a tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:10.474712 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-f4679277-11cd-460b-b889-7052d4f4561a tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:10.482776 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-f4679277-11cd-460b-b889-7052d4f4561a tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1363 microversion: 2.1 time: 0.157192 Aug 31 01:24:10.498280 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 104/207] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:10 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:24:10.498280 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-3dae0866-0ae3-4153-a8d5-33047de8b8d2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:10.498280 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-3dae0866-0ae3-4153-a8d5-33047de8b8d2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: ee6ca45e-29c7-4af8-8aef-72134f23292c] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:10.498280 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3dae0866-0ae3-4153-a8d5-33047de8b8d2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:10.498657 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3dae0866-0ae3-4153-a8d5-33047de8b8d2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:10.498657 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3dae0866-0ae3-4153-a8d5-33047de8b8d2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:10.498657 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3dae0866-0ae3-4153-a8d5-33047de8b8d2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:10.498657 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3dae0866-0ae3-4153-a8d5-33047de8b8d2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:10.498967 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3dae0866-0ae3-4153-a8d5-33047de8b8d2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:10.648791 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-3dae0866-0ae3-4153-a8d5-33047de8b8d2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:10.656505 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-3dae0866-0ae3-4153-a8d5-33047de8b8d2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c" status: 200 len: 1502 microversion: 2.1 time: 0.172012 Aug 31 01:24:10.656973 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 105/208] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:10 2022] GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c => generated 1502 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:10.681788 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-9089159e-e875-4814-b4c6-97cea529e0bd tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db4daf7f-8105-49c3-b56b-9dcd4fd1ac84"}} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:24:10.684230 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-9089159e-e875-4814-b4c6-97cea529e0bd tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: ee6ca45e-29c7-4af8-8aef-72134f23292c] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:10.690045 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9089159e-e875-4814-b4c6-97cea529e0bd tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:10.690671 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9089159e-e875-4814-b4c6-97cea529e0bd tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:10.690938 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9089159e-e875-4814-b4c6-97cea529e0bd tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:10.691705 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9089159e-e875-4814-b4c6-97cea529e0bd tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:10.692753 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9089159e-e875-4814-b4c6-97cea529e0bd tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:10.693179 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9089159e-e875-4814-b4c6-97cea529e0bd tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:10.717522 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.wsgi [None req-9089159e-e875-4814-b4c6-97cea529e0bd tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] HTTP exception thrown: Cannot 'attach_volume' instance ee6ca45e-29c7-4af8-8aef-72134f23292c while it is in vm_state rescued Aug 31 01:24:10.719532 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-9089159e-e875-4814-b4c6-97cea529e0bd tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Request method failure captured: Aug 31 01:24:10.719532 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: request: POST /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c/os-volume_attachments HTTP/1.1 Aug 31 01:24:10.719532 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept: application/json Aug 31 01:24:10.719532 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept-Encoding: identity Aug 31 01:24:10.719532 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Connection: close Aug 31 01:24:10.719532 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Length: 74 Aug 31 01:24:10.719532 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Type: application/json Aug 31 01:24:10.719532 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Host: 10.222.0.20 Aug 31 01:24:10.719532 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Openstack-System-Scope: None Aug 31 01:24:10.719532 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: User-Agent: python-urllib3/1.26.12 Aug 31 01:24:10.719532 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Auth-Token: gAAAAABjDrfcuhRqsMrMNTjo6mUtTq8SbDe9MkKQW1DPTn6rIQGU7H4zaD_aUkmczj_TdvdQczHlpInuXFz_PGsDLzVXnk0dWRrYAJmuB4iGkRs9-IEfWHKdmN10--_NmP9zX5MAawHt61YTHfjDuXxTKPEPlk6b4MU77kQiT6Ux_ynynzBaDZY Aug 31 01:24:10.719532 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Id: None Aug 31 01:24:10.719532 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Name: None Aug 31 01:24:10.719532 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Identity-Status: Confirmed Aug 31 01:24:10.719532 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Is-Admin-Project: True Aug 31 01:24:10.719532 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Id: default Aug 31 01:24:10.719532 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Name: Default Aug 31 01:24:10.719532 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Id: d58414b1dd2342d58cc7665aee50b86b Aug 31 01:24:10.719532 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2102440878 Aug 31 01:24:10.719532 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Role: member,reader Aug 31 01:24:10.719532 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Roles: member,reader Aug 31 01:24:10.721192 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d58414b1dd2342d58cc7665aee50b86b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d58414b1dd2342d58cc7665aee50b86b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d58414b1dd2342d58cc7665aee50b86b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d58414b1dd2342d58cc7665aee50b86b"}]}] Aug 31 01:24:10.721192 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2102440878 Aug 31 01:24:10.721192 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Id: d58414b1dd2342d58cc7665aee50b86b Aug 31 01:24:10.721192 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2102440878 Aug 31 01:24:10.721192 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User: tempest-ServerRescueNegativeTestJSON-2102440878-project Aug 31 01:24:10.721192 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Id: default Aug 31 01:24:10.721192 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Name: Default Aug 31 01:24:10.721192 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Id: 71d0408df86f4be0ac59cc80575a14e2 Aug 31 01:24:10.721192 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2102440878-project Aug 31 01:24:10.721192 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Aug 31 01:24:10.721192 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: {"volumeAttachment": {"volumeId": "db4daf7f-8105-49c3-b56b-9dcd4fd1ac84"}} Aug 31 01:24:10.721192 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: method: > Aug 31 01:24:10.722092 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: exception: Cannot 'attach_volume' instance ee6ca45e-29c7-4af8-8aef-72134f23292c while it is in vm_state rescued Aug 31 01:24:10.722092 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: action_args: {'server_id': 'ee6ca45e-29c7-4af8-8aef-72134f23292c', 'body': {'volumeAttachment': {'volumeId': 'db4daf7f-8105-49c3-b56b-9dcd4fd1ac84'}}} Aug 31 01:24:10.722092 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:24:10.722092 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:24:10.722092 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 01:24:10.722092 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 01:24:10.722092 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 01:24:10.722092 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 01:24:10.722092 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 01:24:10.722092 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 01:24:10.722092 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ee6ca45e-29c7-4af8-8aef-72134f23292c in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 31 01:24:10.722092 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:24:10.722092 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:24:10.722092 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:24:10.722092 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:24:10.722092 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:24:10.722092 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:24:10.722092 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:24:10.722092 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:24:10.723438 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:24:10.723438 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:24:10.723438 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 01:24:10.723438 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 01:24:10.723438 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 01:24:10.723438 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 01:24:10.723438 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 01:24:10.723438 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 01:24:10.723438 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 31 01:24:10.723438 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 01:24:10.723438 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 01:24:10.723438 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 01:24:10.723438 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ee6ca45e-29c7-4af8-8aef-72134f23292c while it is in vm_state rescued Aug 31 01:24:10.723438 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:24:10.723438 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:24:10.723438 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:24:10.723438 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:24:10.723438 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:24:10.723438 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:24:10.724792 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:24:10.724792 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:24:10.724792 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ee6ca45e-29c7-4af8-8aef-72134f23292c while it is in vm_state rescued Aug 31 01:24:10.724792 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:24:10.724792 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-9089159e-e875-4814-b4c6-97cea529e0bd tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Returning 409 to user: Cannot 'attach_volume' instance ee6ca45e-29c7-4af8-8aef-72134f23292c while it is in vm_state rescued {{(pid=121026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:24:10.724792 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-9089159e-e875-4814-b4c6-97cea529e0bd tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "POST /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042987 Aug 31 01:24:10.724792 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 106/209] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 31 01:24:10 2022] POST /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 31 01:24:10.729658 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-1bece3d5-3a25-4430-9797-6f028717d2e9 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:24:10.730186 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-1bece3d5-3a25-4430-9797-6f028717d2e9 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: ee6ca45e-29c7-4af8-8aef-72134f23292c] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:10.735885 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1bece3d5-3a25-4430-9797-6f028717d2e9 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:10.738442 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1bece3d5-3a25-4430-9797-6f028717d2e9 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:10.738442 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1bece3d5-3a25-4430-9797-6f028717d2e9 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:10.738442 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1bece3d5-3a25-4430-9797-6f028717d2e9 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:10.738442 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1bece3d5-3a25-4430-9797-6f028717d2e9 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:10.739326 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1bece3d5-3a25-4430-9797-6f028717d2e9 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:10.943639 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-1bece3d5-3a25-4430-9797-6f028717d2e9 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "POST /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c/action" status: 202 len: 0 microversion: 2.1 time: 0.217319 Aug 31 01:24:10.944291 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 107/210] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 31 01:24:10 2022] POST /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 01:24:10.954151 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-f0385cb3-fa26-42e1-b57f-90563ff78b3c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:10.955122 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-f0385cb3-fa26-42e1-b57f-90563ff78b3c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: ee6ca45e-29c7-4af8-8aef-72134f23292c] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:10.961899 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f0385cb3-fa26-42e1-b57f-90563ff78b3c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:10.962503 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f0385cb3-fa26-42e1-b57f-90563ff78b3c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:10.962915 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f0385cb3-fa26-42e1-b57f-90563ff78b3c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:10.963602 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f0385cb3-fa26-42e1-b57f-90563ff78b3c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:10.964051 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f0385cb3-fa26-42e1-b57f-90563ff78b3c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:10.964582 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f0385cb3-fa26-42e1-b57f-90563ff78b3c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:11.112497 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-f0385cb3-fa26-42e1-b57f-90563ff78b3c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:11.121212 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-f0385cb3-fa26-42e1-b57f-90563ff78b3c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c" status: 200 len: 1510 microversion: 2.1 time: 0.171749 Aug 31 01:24:11.122327 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 108/211] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:10 2022] GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c => generated 1510 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:24:11.506415 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-3ed10095-1143-44d7-b93c-4968d83955eb tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:11.507085 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-3ed10095-1143-44d7-b93c-4968d83955eb tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:11.513660 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3ed10095-1143-44d7-b93c-4968d83955eb tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:11.514139 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3ed10095-1143-44d7-b93c-4968d83955eb tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:11.514759 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3ed10095-1143-44d7-b93c-4968d83955eb tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:11.515459 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3ed10095-1143-44d7-b93c-4968d83955eb tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:11.515913 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3ed10095-1143-44d7-b93c-4968d83955eb tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:11.516327 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3ed10095-1143-44d7-b93c-4968d83955eb tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:11.628565 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-d14423a4-000e-4169-841d-160417fa7154 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "POST /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.169235 Aug 31 01:24:11.630630 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 104/212] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 31 01:24:09 2022] POST /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840/os-volume_attachments => generated 194 bytes in 2173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:24:11.657215 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-3ed10095-1143-44d7-b93c-4968d83955eb tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:11.665623 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-3ed10095-1143-44d7-b93c-4968d83955eb tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1363 microversion: 2.1 time: 0.162737 Aug 31 01:24:11.665623 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 109/213] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:11 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:24:12.144654 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-b3e93eb9-f3ba-4ec0-9647-b61a3785365f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:12.145977 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-b3e93eb9-f3ba-4ec0-9647-b61a3785365f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: ee6ca45e-29c7-4af8-8aef-72134f23292c] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:12.152876 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b3e93eb9-f3ba-4ec0-9647-b61a3785365f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:12.153495 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b3e93eb9-f3ba-4ec0-9647-b61a3785365f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:12.153954 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b3e93eb9-f3ba-4ec0-9647-b61a3785365f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:12.154811 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b3e93eb9-f3ba-4ec0-9647-b61a3785365f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:12.155267 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b3e93eb9-f3ba-4ec0-9647-b61a3785365f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:12.155689 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b3e93eb9-f3ba-4ec0-9647-b61a3785365f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:12.330617 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-b3e93eb9-f3ba-4ec0-9647-b61a3785365f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:12.338296 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-b3e93eb9-f3ba-4ec0-9647-b61a3785365f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c" status: 200 len: 1510 microversion: 2.1 time: 0.198947 Aug 31 01:24:12.338863 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 105/214] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:12 2022] GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c => generated 1510 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:12.687100 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-50b4900e-c0d4-483b-bb5b-c3ee1125a7d2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:12.687788 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-50b4900e-c0d4-483b-bb5b-c3ee1125a7d2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:12.696004 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-50b4900e-c0d4-483b-bb5b-c3ee1125a7d2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:12.696713 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-50b4900e-c0d4-483b-bb5b-c3ee1125a7d2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:12.697072 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-50b4900e-c0d4-483b-bb5b-c3ee1125a7d2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:12.697802 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-50b4900e-c0d4-483b-bb5b-c3ee1125a7d2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:12.698306 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-50b4900e-c0d4-483b-bb5b-c3ee1125a7d2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:12.698842 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-50b4900e-c0d4-483b-bb5b-c3ee1125a7d2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:12.967954 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-50b4900e-c0d4-483b-bb5b-c3ee1125a7d2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:12.976426 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-50b4900e-c0d4-483b-bb5b-c3ee1125a7d2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1363 microversion: 2.1 time: 0.293508 Aug 31 01:24:12.977127 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 110/215] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:12 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1363 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:24:13.361286 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-a07a413f-3f2c-4771-9b6b-585ad406e891 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:13.362047 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-a07a413f-3f2c-4771-9b6b-585ad406e891 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: ee6ca45e-29c7-4af8-8aef-72134f23292c] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:13.370216 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a07a413f-3f2c-4771-9b6b-585ad406e891 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:13.370691 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a07a413f-3f2c-4771-9b6b-585ad406e891 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:13.371124 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a07a413f-3f2c-4771-9b6b-585ad406e891 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:13.371812 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a07a413f-3f2c-4771-9b6b-585ad406e891 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:13.372299 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a07a413f-3f2c-4771-9b6b-585ad406e891 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:13.372715 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a07a413f-3f2c-4771-9b6b-585ad406e891 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:13.584343 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-a07a413f-3f2c-4771-9b6b-585ad406e891 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:13.592039 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-a07a413f-3f2c-4771-9b6b-585ad406e891 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c" status: 200 len: 1510 microversion: 2.1 time: 0.234659 Aug 31 01:24:13.592613 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 106/216] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:13 2022] GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c => generated 1510 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:13.999308 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-5ddb44e8-7b2d-4365-8029-4bb594cadaea tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:14.001693 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-5ddb44e8-7b2d-4365-8029-4bb594cadaea tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:14.011407 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5ddb44e8-7b2d-4365-8029-4bb594cadaea tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:14.012210 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5ddb44e8-7b2d-4365-8029-4bb594cadaea tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:14.012837 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5ddb44e8-7b2d-4365-8029-4bb594cadaea tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:14.013688 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5ddb44e8-7b2d-4365-8029-4bb594cadaea tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:14.014409 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5ddb44e8-7b2d-4365-8029-4bb594cadaea tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:14.014977 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5ddb44e8-7b2d-4365-8029-4bb594cadaea tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:14.180178 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-5ddb44e8-7b2d-4365-8029-4bb594cadaea tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:14.190170 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-5ddb44e8-7b2d-4365-8029-4bb594cadaea tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1363 microversion: 2.1 time: 0.195189 Aug 31 01:24:14.197347 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 111/217] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:13 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:14.613596 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-1223c3c0-0b22-4195-9f58-e69b68276936 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:14.614258 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-1223c3c0-0b22-4195-9f58-e69b68276936 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: ee6ca45e-29c7-4af8-8aef-72134f23292c] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:14.620180 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1223c3c0-0b22-4195-9f58-e69b68276936 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:14.620648 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1223c3c0-0b22-4195-9f58-e69b68276936 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:14.621104 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1223c3c0-0b22-4195-9f58-e69b68276936 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:14.627388 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1223c3c0-0b22-4195-9f58-e69b68276936 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:14.627388 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1223c3c0-0b22-4195-9f58-e69b68276936 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:14.627388 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1223c3c0-0b22-4195-9f58-e69b68276936 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:14.764510 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-1223c3c0-0b22-4195-9f58-e69b68276936 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:14.775034 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-1223c3c0-0b22-4195-9f58-e69b68276936 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c" status: 200 len: 1510 microversion: 2.1 time: 0.165977 Aug 31 01:24:14.775610 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 107/218] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:14 2022] GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:14.994840 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [req-604fb08b-d176-47bf-a1f5-39f1b1751994 req-db7c9335-4e5c-4a5a-86a5-9ad654542056 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "368bac0a-39c9-4f1e-99f9-84223e7de06b", "name": "network-vif-plugged", "status": "completed", "tag": "51441d6e-84dd-48a3-bd25-fade9ebd6634"}]} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:24:15.005289 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-604fb08b-d176-47bf-a1f5-39f1b1751994 req-db7c9335-4e5c-4a5a-86a5-9ad654542056 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:15.005898 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-604fb08b-d176-47bf-a1f5-39f1b1751994 req-db7c9335-4e5c-4a5a-86a5-9ad654542056 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:15.006284 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-604fb08b-d176-47bf-a1f5-39f1b1751994 req-db7c9335-4e5c-4a5a-86a5-9ad654542056 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:15.018366 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.compute.server_external_events [req-604fb08b-d176-47bf-a1f5-39f1b1751994 req-db7c9335-4e5c-4a5a-86a5-9ad654542056 service nova] Creating event network-vif-plugged:51441d6e-84dd-48a3-bd25-fade9ebd6634 for instance 368bac0a-39c9-4f1e-99f9-84223e7de06b on hv-cinder-85528 Aug 31 01:24:15.024209 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [req-604fb08b-d176-47bf-a1f5-39f1b1751994 req-db7c9335-4e5c-4a5a-86a5-9ad654542056 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034044 Aug 31 01:24:15.024809 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 112/219] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:24:15.212008 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-e8770967-ef36-41d1-aef3-4509e431ca7e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:15.212612 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-e8770967-ef36-41d1-aef3-4509e431ca7e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:15.218523 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e8770967-ef36-41d1-aef3-4509e431ca7e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:15.219007 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e8770967-ef36-41d1-aef3-4509e431ca7e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:15.219441 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e8770967-ef36-41d1-aef3-4509e431ca7e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:15.220125 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e8770967-ef36-41d1-aef3-4509e431ca7e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:15.220659 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e8770967-ef36-41d1-aef3-4509e431ca7e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:15.221104 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e8770967-ef36-41d1-aef3-4509e431ca7e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:15.348328 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-e8770967-ef36-41d1-aef3-4509e431ca7e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:15.355945 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-e8770967-ef36-41d1-aef3-4509e431ca7e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1363 microversion: 2.1 time: 0.148352 Aug 31 01:24:15.356497 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 108/220] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:15 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:15.796390 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-e7446cdf-8cde-4af8-aefd-32ac2c4ebeb1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:15.797115 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-e7446cdf-8cde-4af8-aefd-32ac2c4ebeb1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: ee6ca45e-29c7-4af8-8aef-72134f23292c] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:15.815414 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e7446cdf-8cde-4af8-aefd-32ac2c4ebeb1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:15.815908 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e7446cdf-8cde-4af8-aefd-32ac2c4ebeb1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:15.816343 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e7446cdf-8cde-4af8-aefd-32ac2c4ebeb1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:15.817565 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e7446cdf-8cde-4af8-aefd-32ac2c4ebeb1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:15.818030 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e7446cdf-8cde-4af8-aefd-32ac2c4ebeb1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:15.818435 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e7446cdf-8cde-4af8-aefd-32ac2c4ebeb1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:15.840788 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:24:15.970946 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-e7446cdf-8cde-4af8-aefd-32ac2c4ebeb1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:15.986700 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-e7446cdf-8cde-4af8-aefd-32ac2c4ebeb1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c" status: 200 len: 1510 microversion: 2.1 time: 0.194630 Aug 31 01:24:15.987264 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 113/221] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:15 2022] GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c => generated 1510 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:16.377570 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-ef076412-cf3e-42f8-98ba-a3a9e696c908 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:16.378180 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-ef076412-cf3e-42f8-98ba-a3a9e696c908 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:16.384845 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ef076412-cf3e-42f8-98ba-a3a9e696c908 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:16.385330 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ef076412-cf3e-42f8-98ba-a3a9e696c908 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:16.385759 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ef076412-cf3e-42f8-98ba-a3a9e696c908 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:16.386442 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ef076412-cf3e-42f8-98ba-a3a9e696c908 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:16.386892 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ef076412-cf3e-42f8-98ba-a3a9e696c908 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:16.387310 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ef076412-cf3e-42f8-98ba-a3a9e696c908 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:16.529021 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-ef076412-cf3e-42f8-98ba-a3a9e696c908 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:16.537140 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-ef076412-cf3e-42f8-98ba-a3a9e696c908 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1363 microversion: 2.1 time: 0.163607 Aug 31 01:24:16.537708 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 109/222] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:16 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:17.011534 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-64d2c789-cf5d-465b-80ce-880a076d8080 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:17.012340 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-64d2c789-cf5d-465b-80ce-880a076d8080 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: ee6ca45e-29c7-4af8-8aef-72134f23292c] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:17.019215 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-64d2c789-cf5d-465b-80ce-880a076d8080 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:17.019873 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-64d2c789-cf5d-465b-80ce-880a076d8080 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:17.020327 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-64d2c789-cf5d-465b-80ce-880a076d8080 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:17.021052 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-64d2c789-cf5d-465b-80ce-880a076d8080 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:17.021534 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-64d2c789-cf5d-465b-80ce-880a076d8080 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:17.021959 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-64d2c789-cf5d-465b-80ce-880a076d8080 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:17.149034 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-64d2c789-cf5d-465b-80ce-880a076d8080 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:17.157058 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-64d2c789-cf5d-465b-80ce-880a076d8080 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c" status: 200 len: 1516 microversion: 2.1 time: 0.149816 Aug 31 01:24:17.157623 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 114/223] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:17 2022] GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:17.557898 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-114bf370-bf77-43a1-b579-982fa355224a tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:17.558530 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-114bf370-bf77-43a1-b579-982fa355224a tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:17.565129 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-114bf370-bf77-43a1-b579-982fa355224a tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:17.565648 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-114bf370-bf77-43a1-b579-982fa355224a tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:17.566154 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-114bf370-bf77-43a1-b579-982fa355224a tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:17.566850 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-114bf370-bf77-43a1-b579-982fa355224a tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:17.567296 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-114bf370-bf77-43a1-b579-982fa355224a tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:17.567716 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-114bf370-bf77-43a1-b579-982fa355224a tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:17.844485 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-114bf370-bf77-43a1-b579-982fa355224a tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:17.853214 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-114bf370-bf77-43a1-b579-982fa355224a tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1363 microversion: 2.1 time: 0.299037 Aug 31 01:24:17.853972 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 110/224] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:17 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1363 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:18.874107 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-bf80a5da-154a-412d-b437-8589e2b28e45 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Action: 'create', calling method: .version_select at 0x7f1fe18a69d0>, body: {"keypair": {"name": "tempest-keypair-1888667198", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTxxM0G7CGCDLrW0TXK8XCAmydHl1wb2N4Zp7BmJSLja+Tsal/8DrgztAmZH1oF427YKl+Fbwo1ieIAC0cvgZ3ElgbOZqgHJw2WbS+CHkuTJw00N2Z/n8oTNQPgyanOpw=="}} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:24:18.874668 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-4007c04d-531f-4935-a0be-5330db71c7d3 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:18.875079 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-4007c04d-531f-4935-a0be-5330db71c7d3 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:18.882267 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4007c04d-531f-4935-a0be-5330db71c7d3 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:18.882756 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4007c04d-531f-4935-a0be-5330db71c7d3 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:18.883189 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4007c04d-531f-4935-a0be-5330db71c7d3 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:18.883931 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4007c04d-531f-4935-a0be-5330db71c7d3 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:18.884394 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4007c04d-531f-4935-a0be-5330db71c7d3 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:18.884946 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4007c04d-531f-4935-a0be-5330db71c7d3 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:18.892318 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.quota [None req-bf80a5da-154a-412d-b437-8589e2b28e45 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Getting quotas for project d58414b1dd2342d58cc7665aee50b86b. Resources: {'key_pairs'} {{(pid=121026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 01:24:18.897582 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.quota [None req-bf80a5da-154a-412d-b437-8589e2b28e45 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Getting quotas for user 71d0408df86f4be0ac59cc80575a14e2 and project d58414b1dd2342d58cc7665aee50b86b. Resources: {'key_pairs'} {{(pid=121026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 01:24:18.999099 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-bf80a5da-154a-412d-b437-8589e2b28e45 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.128767 Aug 31 01:24:18.999811 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 115/225] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Aug 31 01:24:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:24:19.264455 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-4007c04d-531f-4935-a0be-5330db71c7d3 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:19.272478 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-4007c04d-531f-4935-a0be-5330db71c7d3 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1363 microversion: 2.1 time: 0.402101 Aug 31 01:24:19.273094 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 111/226] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:18 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1363 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:20.294411 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-6580058a-4f6a-4733-a2f2-12e3b1290105 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:20.294998 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-6580058a-4f6a-4733-a2f2-12e3b1290105 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:20.301854 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6580058a-4f6a-4733-a2f2-12e3b1290105 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:20.308105 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6580058a-4f6a-4733-a2f2-12e3b1290105 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:20.308105 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6580058a-4f6a-4733-a2f2-12e3b1290105 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:20.308105 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6580058a-4f6a-4733-a2f2-12e3b1290105 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:20.308105 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6580058a-4f6a-4733-a2f2-12e3b1290105 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:20.308436 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6580058a-4f6a-4733-a2f2-12e3b1290105 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:20.449392 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-6580058a-4f6a-4733-a2f2-12e3b1290105 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:20.459046 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-6580058a-4f6a-4733-a2f2-12e3b1290105 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1549 microversion: 2.1 time: 0.169011 Aug 31 01:24:20.459755 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 116/227] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:20 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1549 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:20.480683 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-b501c3e1-27c8-4d30-95ff-ea8b47060e49 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:20.481262 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-b501c3e1-27c8-4d30-95ff-ea8b47060e49 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:20.497874 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b501c3e1-27c8-4d30-95ff-ea8b47060e49 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:20.498620 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b501c3e1-27c8-4d30-95ff-ea8b47060e49 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:20.499271 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b501c3e1-27c8-4d30-95ff-ea8b47060e49 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:20.500197 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b501c3e1-27c8-4d30-95ff-ea8b47060e49 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:20.500665 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b501c3e1-27c8-4d30-95ff-ea8b47060e49 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:20.501280 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b501c3e1-27c8-4d30-95ff-ea8b47060e49 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:20.606669 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-b501c3e1-27c8-4d30-95ff-ea8b47060e49 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.129791 Aug 31 01:24:20.607728 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 112/228] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Aug 31 01:24:20 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b/os-interface => generated 285 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:24:21.581307 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-33e954c1-50aa-4899-a993-aceed650c0d8 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2053445061", "imageRef": "ed6d3236-defa-4ccf-90ba-343c0d0ad58e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0303b68a-9736-48eb-90f1-d3c52026d074"}], "security_groups": [{"name": "tempest-securitygroup--147924674"}], "key_name": "tempest-keypair-1888667198", "user_data": "}} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:24:21.746495 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.network.neutron [None req-33e954c1-50aa-4899-a993-aceed650c0d8 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] validate_networks() for [('0303b68a-9736-48eb-90f1-d3c52026d074', None, None, None, None, None)] {{(pid=121026) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 01:24:22.292308 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-b1387a82-b56e-4583-87db-31a88e7b41a7 req-e1b6ae8f-6dcb-433c-bbfc-e4d68ea2136b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "368bac0a-39c9-4f1e-99f9-84223e7de06b", "tag": "51441d6e-84dd-48a3-bd25-fade9ebd6634"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:24:22.323273 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-b1387a82-b56e-4583-87db-31a88e7b41a7 req-e1b6ae8f-6dcb-433c-bbfc-e4d68ea2136b service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:22.323911 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-b1387a82-b56e-4583-87db-31a88e7b41a7 req-e1b6ae8f-6dcb-433c-bbfc-e4d68ea2136b service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:22.324603 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-b1387a82-b56e-4583-87db-31a88e7b41a7 req-e1b6ae8f-6dcb-433c-bbfc-e4d68ea2136b service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:22.354478 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-b1387a82-b56e-4583-87db-31a88e7b41a7 req-e1b6ae8f-6dcb-433c-bbfc-e4d68ea2136b service nova] Creating event network-changed:51441d6e-84dd-48a3-bd25-fade9ebd6634 for instance 368bac0a-39c9-4f1e-99f9-84223e7de06b on hv-cinder-85528 Aug 31 01:24:22.361399 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-b1387a82-b56e-4583-87db-31a88e7b41a7 req-e1b6ae8f-6dcb-433c-bbfc-e4d68ea2136b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073817 Aug 31 01:24:22.362560 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 113/229] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:24:22.477935 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-a9163cec-d39f-48f4-b52d-03230f1c787b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Action: 'create', calling method: .version_select at 0x7f1fe17f7ca0>, body: {"keypair": {"name": "tempest-keypair-1941655865", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9nqOtSn/+ttlaGijC2gQKtyTVXWys05QWxp1f9HwT9nZYl0T6nEfz1cpoCAl/nWf8/b4ftXdYFNQgE84L5wfK0EIUOuwgQbnc7M9NmDbaw6buEDn4CsDDCodp/Hq/l8Q=="}} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:24:22.506376 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.quota [None req-a9163cec-d39f-48f4-b52d-03230f1c787b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Getting quotas for project 164da7d4776d4e9f8cf6497aa784d312. Resources: {'key_pairs'} {{(pid=121025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 01:24:22.515396 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.quota [None req-a9163cec-d39f-48f4-b52d-03230f1c787b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Getting quotas for user 52ed99737fd240789bb682fd9bf11be3 and project 164da7d4776d4e9f8cf6497aa784d312. Resources: {'key_pairs'} {{(pid=121025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 01:24:22.610876 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-a9163cec-d39f-48f4-b52d-03230f1c787b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.138206 Aug 31 01:24:22.621664 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 114/230] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Aug 31 01:24:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:24:22.688067 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.virt.hardware [None req-33e954c1-50aa-4899-a993-aceed650c0d8 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Flavor limits 0:0:0 {{(pid=121026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 01:24:22.688560 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.virt.hardware [None req-33e954c1-50aa-4899-a993-aceed650c0d8 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Image limits 0:0:0 {{(pid=121026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 01:24:22.689014 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.virt.hardware [None req-33e954c1-50aa-4899-a993-aceed650c0d8 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Flavor pref 0:0:0 {{(pid=121026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 01:24:22.689419 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.virt.hardware [None req-33e954c1-50aa-4899-a993-aceed650c0d8 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Image pref 0:0:0 {{(pid=121026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 01:24:22.689992 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.virt.hardware [None req-33e954c1-50aa-4899-a993-aceed650c0d8 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 01:24:22.701036 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-33e954c1-50aa-4899-a993-aceed650c0d8 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:22.701651 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-33e954c1-50aa-4899-a993-aceed650c0d8 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:22.702090 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-33e954c1-50aa-4899-a993-aceed650c0d8 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:22.702894 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-33e954c1-50aa-4899-a993-aceed650c0d8 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:22.707526 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-33e954c1-50aa-4899-a993-aceed650c0d8 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:22.707526 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-33e954c1-50aa-4899-a993-aceed650c0d8 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:22.726977 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.quota [None req-33e954c1-50aa-4899-a993-aceed650c0d8 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Getting quotas for project d58414b1dd2342d58cc7665aee50b86b. Resources: {'instances', 'cores', 'ram'} {{(pid=121026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 01:24:22.732289 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.quota [None req-33e954c1-50aa-4899-a993-aceed650c0d8 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Getting quotas for user 71d0408df86f4be0ac59cc80575a14e2 and project d58414b1dd2342d58cc7665aee50b86b. Resources: {'instances', 'cores', 'ram'} {{(pid=121026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 01:24:22.758361 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-33e954c1-50aa-4899-a993-aceed650c0d8 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Going to run 1 instances... {{(pid=121026) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 01:24:22.760914 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-33e954c1-50aa-4899-a993-aceed650c0d8 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ed6d3236-defa-4ccf-90ba-343c0d0ad58e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121026) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 01:24:22.979358 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-33e954c1-50aa-4899-a993-aceed650c0d8 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.402498 Aug 31 01:24:22.980082 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 117/231] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 31 01:24:21 2022] POST /compute/v2.1/servers => generated 408 bytes in 1404 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 01:24:22.991618 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-04545223-22bc-4a8b-b105-6519da3090d1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:22.993868 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-04545223-22bc-4a8b-b105-6519da3090d1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:23.158950 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-04545223-22bc-4a8b-b105-6519da3090d1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:23.168997 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-04545223-22bc-4a8b-b105-6519da3090d1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1246 microversion: 2.1 time: 0.179768 Aug 31 01:24:23.171010 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 115/232] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:22 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1246 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:24.192561 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-12feaac3-4698-4a87-aaac-c2015dae16e7 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:24.193207 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-12feaac3-4698-4a87-aaac-c2015dae16e7 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:24.199353 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-12feaac3-4698-4a87-aaac-c2015dae16e7 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:24.199837 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-12feaac3-4698-4a87-aaac-c2015dae16e7 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:24.200270 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-12feaac3-4698-4a87-aaac-c2015dae16e7 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:24.201000 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-12feaac3-4698-4a87-aaac-c2015dae16e7 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:24.201489 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-12feaac3-4698-4a87-aaac-c2015dae16e7 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:24.201947 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-12feaac3-4698-4a87-aaac-c2015dae16e7 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:24.315738 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-12feaac3-4698-4a87-aaac-c2015dae16e7 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:24.324168 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-12feaac3-4698-4a87-aaac-c2015dae16e7 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1250 microversion: 2.1 time: 0.136546 Aug 31 01:24:24.325131 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 118/233] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:24 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1250 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:25.194071 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-aba886da-1bc5-4613-9d2e-478e1c853e28 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-867445494", "imageRef": "ed6d3236-defa-4ccf-90ba-343c0d0ad58e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0760f9a5-d813-4a0f-bcef-9988cda0c948"}], "security_groups": [{"name": "tempest-securitygroup--1609455248"}], "key_name": "tempest-keypair-1941655865", "user_data": "}} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:24:25.202934 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=1 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:24:25.302082 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.network.neutron [None req-aba886da-1bc5-4613-9d2e-478e1c853e28 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] validate_networks() for [('0760f9a5-d813-4a0f-bcef-9988cda0c948', None, None, None, None, None)] {{(pid=121025) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 01:24:25.345346 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-d2ed5f00-0de2-468f-b0a0-86f0d16370d5 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:25.345976 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-d2ed5f00-0de2-468f-b0a0-86f0d16370d5 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:25.352809 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d2ed5f00-0de2-468f-b0a0-86f0d16370d5 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:25.353720 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d2ed5f00-0de2-468f-b0a0-86f0d16370d5 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:25.354389 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d2ed5f00-0de2-468f-b0a0-86f0d16370d5 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:25.355092 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d2ed5f00-0de2-468f-b0a0-86f0d16370d5 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:25.355547 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d2ed5f00-0de2-468f-b0a0-86f0d16370d5 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:25.355967 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d2ed5f00-0de2-468f-b0a0-86f0d16370d5 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:25.444176 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-d2ed5f00-0de2-468f-b0a0-86f0d16370d5 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:25.453461 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-d2ed5f00-0de2-468f-b0a0-86f0d16370d5 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1298 microversion: 2.1 time: 0.112010 Aug 31 01:24:25.454303 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 119/234] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:25 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1298 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:25.868084 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-aba886da-1bc5-4613-9d2e-478e1c853e28 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Flavor limits 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 01:24:25.868560 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-aba886da-1bc5-4613-9d2e-478e1c853e28 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Image limits 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 01:24:25.869037 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-aba886da-1bc5-4613-9d2e-478e1c853e28 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Flavor pref 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 01:24:25.869497 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-aba886da-1bc5-4613-9d2e-478e1c853e28 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Image pref 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 01:24:25.872841 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-aba886da-1bc5-4613-9d2e-478e1c853e28 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 01:24:25.899744 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-aba886da-1bc5-4613-9d2e-478e1c853e28 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:25.900353 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-aba886da-1bc5-4613-9d2e-478e1c853e28 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:25.900820 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-aba886da-1bc5-4613-9d2e-478e1c853e28 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:25.901668 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-aba886da-1bc5-4613-9d2e-478e1c853e28 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:25.902282 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-aba886da-1bc5-4613-9d2e-478e1c853e28 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:25.903037 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-aba886da-1bc5-4613-9d2e-478e1c853e28 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:25.922649 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.quota [None req-aba886da-1bc5-4613-9d2e-478e1c853e28 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Getting quotas for project 164da7d4776d4e9f8cf6497aa784d312. Resources: {'instances', 'cores', 'ram'} {{(pid=121025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 01:24:25.927646 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.quota [None req-aba886da-1bc5-4613-9d2e-478e1c853e28 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Getting quotas for user 52ed99737fd240789bb682fd9bf11be3 and project 164da7d4776d4e9f8cf6497aa784d312. Resources: {'instances', 'cores', 'ram'} {{(pid=121025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 01:24:25.940319 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-aba886da-1bc5-4613-9d2e-478e1c853e28 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Going to run 1 instances... {{(pid=121025) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 01:24:25.943284 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-aba886da-1bc5-4613-9d2e-478e1c853e28 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 082d7637-9b1c-469c-b688-c76ca61e9f6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ed6d3236-defa-4ccf-90ba-343c0d0ad58e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 01:24:26.091433 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-aba886da-1bc5-4613-9d2e-478e1c853e28 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.901468 Aug 31 01:24:26.092000 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 116/235] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 31 01:24:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 01:24:26.103302 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-dd65fdbd-ce6d-404c-b5ca-f865d639e5ad tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:26.103915 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-dd65fdbd-ce6d-404c-b5ca-f865d639e5ad tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 082d7637-9b1c-469c-b688-c76ca61e9f6b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:26.174209 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-dd65fdbd-ce6d-404c-b5ca-f865d639e5ad tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:26.185973 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-dd65fdbd-ce6d-404c-b5ca-f865d639e5ad tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b" status: 200 len: 1241 microversion: 2.1 time: 0.086501 Aug 31 01:24:26.187203 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 120/236] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:26 2022] GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:26.270782 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-b7b6ab6c-6e18-4595-8093-56748d0bf9d8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:26.271555 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-b7b6ab6c-6e18-4595-8093-56748d0bf9d8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:26.278020 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b7b6ab6c-6e18-4595-8093-56748d0bf9d8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:26.278588 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b7b6ab6c-6e18-4595-8093-56748d0bf9d8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:26.279060 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b7b6ab6c-6e18-4595-8093-56748d0bf9d8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:26.280143 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b7b6ab6c-6e18-4595-8093-56748d0bf9d8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:26.280850 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b7b6ab6c-6e18-4595-8093-56748d0bf9d8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:26.281664 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b7b6ab6c-6e18-4595-8093-56748d0bf9d8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:26.312944 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-b7b6ab6c-6e18-4595-8093-56748d0bf9d8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5/ips" status: 200 len: 152 microversion: 2.20 time: 0.046717 Aug 31 01:24:26.313509 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 117/237] 10.222.0.20 () {60 vars in 1289 bytes} [Wed Aug 31 01:24:26 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5/ips => generated 152 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 01:24:26.476601 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-146880aa-5a7a-4bd0-978f-4d1422c3d9ea tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:26.477846 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-146880aa-5a7a-4bd0-978f-4d1422c3d9ea tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:26.488491 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-146880aa-5a7a-4bd0-978f-4d1422c3d9ea tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:26.489002 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-146880aa-5a7a-4bd0-978f-4d1422c3d9ea tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:26.489434 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-146880aa-5a7a-4bd0-978f-4d1422c3d9ea tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:26.490190 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-146880aa-5a7a-4bd0-978f-4d1422c3d9ea tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:26.490793 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-146880aa-5a7a-4bd0-978f-4d1422c3d9ea tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:26.491215 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-146880aa-5a7a-4bd0-978f-4d1422c3d9ea tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:26.561762 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-146880aa-5a7a-4bd0-978f-4d1422c3d9ea tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:26.569640 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-146880aa-5a7a-4bd0-978f-4d1422c3d9ea tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1304 microversion: 2.1 time: 0.097767 Aug 31 01:24:26.570213 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 121/238] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:26 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:24:27.216403 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-76a1b353-f6f3-4a93-a072-0e31abfe3511 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:27.217038 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-76a1b353-f6f3-4a93-a072-0e31abfe3511 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 082d7637-9b1c-469c-b688-c76ca61e9f6b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:27.223000 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-76a1b353-f6f3-4a93-a072-0e31abfe3511 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:27.223483 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-76a1b353-f6f3-4a93-a072-0e31abfe3511 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:27.223943 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-76a1b353-f6f3-4a93-a072-0e31abfe3511 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:27.224628 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-76a1b353-f6f3-4a93-a072-0e31abfe3511 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:27.225107 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-76a1b353-f6f3-4a93-a072-0e31abfe3511 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:27.225528 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-76a1b353-f6f3-4a93-a072-0e31abfe3511 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:27.284932 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-76a1b353-f6f3-4a93-a072-0e31abfe3511 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:27.292445 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-76a1b353-f6f3-4a93-a072-0e31abfe3511 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b" status: 200 len: 1245 microversion: 2.1 time: 0.079886 Aug 31 01:24:27.293048 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 118/239] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:27 2022] GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:27.595353 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-b99600fb-54b7-4aee-817e-dc45cac5ae2a tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:27.595982 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-b99600fb-54b7-4aee-817e-dc45cac5ae2a tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:27.602952 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b99600fb-54b7-4aee-817e-dc45cac5ae2a tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:27.603427 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b99600fb-54b7-4aee-817e-dc45cac5ae2a tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:27.603854 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b99600fb-54b7-4aee-817e-dc45cac5ae2a tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:27.604578 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b99600fb-54b7-4aee-817e-dc45cac5ae2a tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:27.612087 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b99600fb-54b7-4aee-817e-dc45cac5ae2a tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:27.612087 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b99600fb-54b7-4aee-817e-dc45cac5ae2a tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:27.737319 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-b99600fb-54b7-4aee-817e-dc45cac5ae2a tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:27.745638 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-b99600fb-54b7-4aee-817e-dc45cac5ae2a tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1371 microversion: 2.1 time: 0.154267 Aug 31 01:24:27.746201 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 122/240] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:27 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:28.313475 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-8bb22b53-e6b3-49c5-8452-59b49096b0fe tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:28.314098 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-8bb22b53-e6b3-49c5-8452-59b49096b0fe tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 082d7637-9b1c-469c-b688-c76ca61e9f6b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:28.321186 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8bb22b53-e6b3-49c5-8452-59b49096b0fe tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:28.321679 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8bb22b53-e6b3-49c5-8452-59b49096b0fe tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:28.322112 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8bb22b53-e6b3-49c5-8452-59b49096b0fe tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:28.322801 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8bb22b53-e6b3-49c5-8452-59b49096b0fe tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:28.323253 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8bb22b53-e6b3-49c5-8452-59b49096b0fe tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:28.323676 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8bb22b53-e6b3-49c5-8452-59b49096b0fe tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:28.403881 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-8bb22b53-e6b3-49c5-8452-59b49096b0fe tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:28.412134 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-8bb22b53-e6b3-49c5-8452-59b49096b0fe tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b" status: 200 len: 1245 microversion: 2.1 time: 0.102468 Aug 31 01:24:28.412709 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 119/241] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:28 2022] GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b => generated 1245 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:28.766188 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-8d0abf8a-ea98-4cdc-bea7-718d3b569f33 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:28.766800 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-8d0abf8a-ea98-4cdc-bea7-718d3b569f33 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:28.769335 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:24:28.774162 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8d0abf8a-ea98-4cdc-bea7-718d3b569f33 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:28.774646 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8d0abf8a-ea98-4cdc-bea7-718d3b569f33 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:28.775081 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8d0abf8a-ea98-4cdc-bea7-718d3b569f33 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:28.775779 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8d0abf8a-ea98-4cdc-bea7-718d3b569f33 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:28.776277 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8d0abf8a-ea98-4cdc-bea7-718d3b569f33 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:28.776705 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8d0abf8a-ea98-4cdc-bea7-718d3b569f33 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:28.982547 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-8d0abf8a-ea98-4cdc-bea7-718d3b569f33 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:28.991309 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-8d0abf8a-ea98-4cdc-bea7-718d3b569f33 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1371 microversion: 2.1 time: 0.228872 Aug 31 01:24:28.991933 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 123/242] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:28 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1371 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:29.173745 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-779db085-7222-4b58-8f4f-6f3b91098178 req-308fe906-9425-431d-b5db-d03693146752 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "380077d1-0ed7-47ac-9e19-5425164e6da1", "tag": "6715d43f-3649-46e9-b421-5ed74efa38b9"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:24:29.184258 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-779db085-7222-4b58-8f4f-6f3b91098178 req-308fe906-9425-431d-b5db-d03693146752 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:29.185007 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-779db085-7222-4b58-8f4f-6f3b91098178 req-308fe906-9425-431d-b5db-d03693146752 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:29.185440 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-779db085-7222-4b58-8f4f-6f3b91098178 req-308fe906-9425-431d-b5db-d03693146752 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:29.196872 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-779db085-7222-4b58-8f4f-6f3b91098178 req-308fe906-9425-431d-b5db-d03693146752 service nova] Creating event network-changed:6715d43f-3649-46e9-b421-5ed74efa38b9 for instance 380077d1-0ed7-47ac-9e19-5425164e6da1 on hv-cinder-85528 Aug 31 01:24:29.201886 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-779db085-7222-4b58-8f4f-6f3b91098178 req-308fe906-9425-431d-b5db-d03693146752 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031873 Aug 31 01:24:29.205309 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 120/243] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:24:29.434138 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-9e1ff99a-e30a-40f5-b623-b522bd9c19b3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:29.434938 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-9e1ff99a-e30a-40f5-b623-b522bd9c19b3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 082d7637-9b1c-469c-b688-c76ca61e9f6b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:29.441461 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9e1ff99a-e30a-40f5-b623-b522bd9c19b3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:29.442631 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9e1ff99a-e30a-40f5-b623-b522bd9c19b3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:29.443133 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9e1ff99a-e30a-40f5-b623-b522bd9c19b3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:29.443897 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9e1ff99a-e30a-40f5-b623-b522bd9c19b3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:29.444443 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9e1ff99a-e30a-40f5-b623-b522bd9c19b3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:29.445220 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9e1ff99a-e30a-40f5-b623-b522bd9c19b3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:29.529480 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-9e1ff99a-e30a-40f5-b623-b522bd9c19b3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:29.537860 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-9e1ff99a-e30a-40f5-b623-b522bd9c19b3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b" status: 200 len: 1245 microversion: 2.1 time: 0.107562 Aug 31 01:24:29.538391 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 124/244] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:29 2022] GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b => generated 1245 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:30.014109 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-6c05bdd7-20b1-4b88-97fb-153414a08e24 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:30.014885 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-6c05bdd7-20b1-4b88-97fb-153414a08e24 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:30.021796 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6c05bdd7-20b1-4b88-97fb-153414a08e24 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:30.022728 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6c05bdd7-20b1-4b88-97fb-153414a08e24 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:30.023475 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6c05bdd7-20b1-4b88-97fb-153414a08e24 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:30.024262 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6c05bdd7-20b1-4b88-97fb-153414a08e24 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:30.024977 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6c05bdd7-20b1-4b88-97fb-153414a08e24 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:30.025638 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6c05bdd7-20b1-4b88-97fb-153414a08e24 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:30.239514 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-6c05bdd7-20b1-4b88-97fb-153414a08e24 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:30.248015 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-6c05bdd7-20b1-4b88-97fb-153414a08e24 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1371 microversion: 2.1 time: 0.239228 Aug 31 01:24:30.248674 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 121/245] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:30 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1371 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:30.559185 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-201bbe4f-8bdf-4c35-8fb2-8bcd00595941 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:30.559793 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-201bbe4f-8bdf-4c35-8fb2-8bcd00595941 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 082d7637-9b1c-469c-b688-c76ca61e9f6b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:30.565842 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-201bbe4f-8bdf-4c35-8fb2-8bcd00595941 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:30.566321 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-201bbe4f-8bdf-4c35-8fb2-8bcd00595941 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:30.567389 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-201bbe4f-8bdf-4c35-8fb2-8bcd00595941 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:30.568077 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-201bbe4f-8bdf-4c35-8fb2-8bcd00595941 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:30.568527 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-201bbe4f-8bdf-4c35-8fb2-8bcd00595941 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:30.568980 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-201bbe4f-8bdf-4c35-8fb2-8bcd00595941 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:30.632552 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-201bbe4f-8bdf-4c35-8fb2-8bcd00595941 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:30.640475 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-201bbe4f-8bdf-4c35-8fb2-8bcd00595941 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b" status: 200 len: 1293 microversion: 2.1 time: 0.085117 Aug 31 01:24:30.641077 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 125/246] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:30 2022] GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:31.269019 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-0a670ccd-66d0-400c-b5b9-e2bb9f78dc83 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:31.269628 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-0a670ccd-66d0-400c-b5b9-e2bb9f78dc83 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:31.276912 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0a670ccd-66d0-400c-b5b9-e2bb9f78dc83 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:31.281443 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0a670ccd-66d0-400c-b5b9-e2bb9f78dc83 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:31.281443 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0a670ccd-66d0-400c-b5b9-e2bb9f78dc83 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:31.281443 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0a670ccd-66d0-400c-b5b9-e2bb9f78dc83 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:31.281443 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0a670ccd-66d0-400c-b5b9-e2bb9f78dc83 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:31.281831 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0a670ccd-66d0-400c-b5b9-e2bb9f78dc83 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:31.282181 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:24:31.407491 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-0a670ccd-66d0-400c-b5b9-e2bb9f78dc83 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:31.415575 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-0a670ccd-66d0-400c-b5b9-e2bb9f78dc83 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1371 microversion: 2.1 time: 0.150432 Aug 31 01:24:31.416134 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 122/247] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:31 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:31.570701 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-c323372e-4e87-4936-afa8-1f0a64b8cedb tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:24:31.571215 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-c323372e-4e87-4936-afa8-1f0a64b8cedb tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:31.577756 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c323372e-4e87-4936-afa8-1f0a64b8cedb tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:31.578239 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c323372e-4e87-4936-afa8-1f0a64b8cedb tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:31.578915 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c323372e-4e87-4936-afa8-1f0a64b8cedb tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:31.579615 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c323372e-4e87-4936-afa8-1f0a64b8cedb tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:31.580065 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c323372e-4e87-4936-afa8-1f0a64b8cedb tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:31.580484 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c323372e-4e87-4936-afa8-1f0a64b8cedb tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:31.603012 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.objects.instance [None req-c323372e-4e87-4936-afa8-1f0a64b8cedb tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lazy-loading 'flavor' on Instance uuid 12814f73-696a-4dc2-9182-7779bfe90ad5 {{(pid=121026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:24:31.661687 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-c6d702b2-0e8c-4bf8-a836-51f65aada94a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:31.662293 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-c6d702b2-0e8c-4bf8-a836-51f65aada94a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 082d7637-9b1c-469c-b688-c76ca61e9f6b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:31.668120 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c6d702b2-0e8c-4bf8-a836-51f65aada94a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:31.668594 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c6d702b2-0e8c-4bf8-a836-51f65aada94a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:31.669061 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c6d702b2-0e8c-4bf8-a836-51f65aada94a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:31.669743 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c6d702b2-0e8c-4bf8-a836-51f65aada94a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:31.670186 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c6d702b2-0e8c-4bf8-a836-51f65aada94a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:31.670599 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c6d702b2-0e8c-4bf8-a836-51f65aada94a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:31.733537 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-c6d702b2-0e8c-4bf8-a836-51f65aada94a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:31.741188 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-c6d702b2-0e8c-4bf8-a836-51f65aada94a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b" status: 200 len: 1293 microversion: 2.1 time: 0.083860 Aug 31 01:24:31.741768 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 123/248] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:31 2022] GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b => generated 1293 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:24:32.121299 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-c323372e-4e87-4936-afa8-1f0a64b8cedb tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "POST /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5/action" status: 202 len: 0 microversion: 2.20 time: 0.554422 Aug 31 01:24:32.121828 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 126/249] 10.222.0.20 () {62 vars in 1319 bytes} [Wed Aug 31 01:24:31 2022] POST /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5/action => generated 0 bytes in 556 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 01:24:32.130651 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-342820d0-fe80-40c4-8174-60b606423555 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:32.131263 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-342820d0-fe80-40c4-8174-60b606423555 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:32.137227 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-342820d0-fe80-40c4-8174-60b606423555 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:32.137708 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-342820d0-fe80-40c4-8174-60b606423555 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:32.138139 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-342820d0-fe80-40c4-8174-60b606423555 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:32.138823 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-342820d0-fe80-40c4-8174-60b606423555 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:32.139316 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-342820d0-fe80-40c4-8174-60b606423555 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:32.139737 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-342820d0-fe80-40c4-8174-60b606423555 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:32.269390 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-342820d0-fe80-40c4-8174-60b606423555 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:32.278737 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-342820d0-fe80-40c4-8174-60b606423555 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:32.280254 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-342820d0-fe80-40c4-8174-60b606423555 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:32.281448 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-342820d0-fe80-40c4-8174-60b606423555 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1725 microversion: 2.20 time: 0.155180 Aug 31 01:24:32.282009 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 124/250] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:24:32 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:24:32.436909 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-6260d48d-3506-46aa-b555-4cc0df2b812e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:32.437608 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-6260d48d-3506-46aa-b555-4cc0df2b812e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:32.444418 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6260d48d-3506-46aa-b555-4cc0df2b812e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:32.444925 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6260d48d-3506-46aa-b555-4cc0df2b812e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:32.445359 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6260d48d-3506-46aa-b555-4cc0df2b812e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:32.446065 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6260d48d-3506-46aa-b555-4cc0df2b812e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:32.446513 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6260d48d-3506-46aa-b555-4cc0df2b812e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:32.446931 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6260d48d-3506-46aa-b555-4cc0df2b812e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:32.576324 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-6260d48d-3506-46aa-b555-4cc0df2b812e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:32.584705 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-6260d48d-3506-46aa-b555-4cc0df2b812e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1371 microversion: 2.1 time: 0.152079 Aug 31 01:24:32.585293 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 127/251] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:32 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:32.761281 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-70ebd45b-0bc8-4245-9613-1902fab49659 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:32.762609 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-70ebd45b-0bc8-4245-9613-1902fab49659 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 082d7637-9b1c-469c-b688-c76ca61e9f6b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:32.767846 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-70ebd45b-0bc8-4245-9613-1902fab49659 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:32.768332 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-70ebd45b-0bc8-4245-9613-1902fab49659 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:32.768790 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-70ebd45b-0bc8-4245-9613-1902fab49659 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:32.769483 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-70ebd45b-0bc8-4245-9613-1902fab49659 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:32.769939 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-70ebd45b-0bc8-4245-9613-1902fab49659 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:32.770389 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-70ebd45b-0bc8-4245-9613-1902fab49659 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:32.834459 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-70ebd45b-0bc8-4245-9613-1902fab49659 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:32.842033 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-70ebd45b-0bc8-4245-9613-1902fab49659 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b" status: 200 len: 1293 microversion: 2.1 time: 0.084716 Aug 31 01:24:32.842595 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 125/252] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:32 2022] GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:33.303681 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-a7d2efe9-f4c5-400c-bb75-3b8080b75348 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:33.304240 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-a7d2efe9-f4c5-400c-bb75-3b8080b75348 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:33.306251 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell0:SELECT=2 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:24:33.311024 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a7d2efe9-f4c5-400c-bb75-3b8080b75348 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:33.311504 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a7d2efe9-f4c5-400c-bb75-3b8080b75348 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:33.311932 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a7d2efe9-f4c5-400c-bb75-3b8080b75348 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:33.312612 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a7d2efe9-f4c5-400c-bb75-3b8080b75348 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:33.313111 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a7d2efe9-f4c5-400c-bb75-3b8080b75348 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:33.313527 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a7d2efe9-f4c5-400c-bb75-3b8080b75348 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:33.439618 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-a7d2efe9-f4c5-400c-bb75-3b8080b75348 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:33.447835 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-a7d2efe9-f4c5-400c-bb75-3b8080b75348 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:33.449344 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-a7d2efe9-f4c5-400c-bb75-3b8080b75348 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:33.450509 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-a7d2efe9-f4c5-400c-bb75-3b8080b75348 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1725 microversion: 2.20 time: 0.150913 Aug 31 01:24:33.451086 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 128/253] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:24:33 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:24:33.605378 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-b343a500-b3f8-411c-b2e4-e92cbe2340db tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:33.605996 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-b343a500-b3f8-411c-b2e4-e92cbe2340db tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:33.612461 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b343a500-b3f8-411c-b2e4-e92cbe2340db tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:33.612982 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b343a500-b3f8-411c-b2e4-e92cbe2340db tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:33.613433 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b343a500-b3f8-411c-b2e4-e92cbe2340db tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:33.614103 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b343a500-b3f8-411c-b2e4-e92cbe2340db tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:33.614558 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b343a500-b3f8-411c-b2e4-e92cbe2340db tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:33.614982 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b343a500-b3f8-411c-b2e4-e92cbe2340db tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:33.743306 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-b343a500-b3f8-411c-b2e4-e92cbe2340db tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:33.751395 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-b343a500-b3f8-411c-b2e4-e92cbe2340db tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1371 microversion: 2.1 time: 0.149843 Aug 31 01:24:33.751967 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 126/254] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:33 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:33.863239 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-a174284d-7f97-4435-9705-9d39b6dfbaa8 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:33.863852 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-a174284d-7f97-4435-9705-9d39b6dfbaa8 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 082d7637-9b1c-469c-b688-c76ca61e9f6b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:33.870383 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a174284d-7f97-4435-9705-9d39b6dfbaa8 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:33.870854 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a174284d-7f97-4435-9705-9d39b6dfbaa8 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:33.871290 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a174284d-7f97-4435-9705-9d39b6dfbaa8 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:33.871977 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a174284d-7f97-4435-9705-9d39b6dfbaa8 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:33.872433 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a174284d-7f97-4435-9705-9d39b6dfbaa8 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:33.873063 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a174284d-7f97-4435-9705-9d39b6dfbaa8 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:33.938021 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-a174284d-7f97-4435-9705-9d39b6dfbaa8 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:33.946201 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-a174284d-7f97-4435-9705-9d39b6dfbaa8 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b" status: 200 len: 1293 microversion: 2.1 time: 0.086828 Aug 31 01:24:33.946764 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 129/255] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:33 2022] GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:34.474892 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-32424bc2-358a-459d-bb4f-6a68797dd16a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:34.475514 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-32424bc2-358a-459d-bb4f-6a68797dd16a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:34.481474 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-32424bc2-358a-459d-bb4f-6a68797dd16a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:34.481979 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-32424bc2-358a-459d-bb4f-6a68797dd16a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:34.482389 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-32424bc2-358a-459d-bb4f-6a68797dd16a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:34.483068 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-32424bc2-358a-459d-bb4f-6a68797dd16a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:34.483527 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-32424bc2-358a-459d-bb4f-6a68797dd16a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:34.483946 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-32424bc2-358a-459d-bb4f-6a68797dd16a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:34.614096 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-32424bc2-358a-459d-bb4f-6a68797dd16a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:34.622345 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-32424bc2-358a-459d-bb4f-6a68797dd16a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:34.623850 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-32424bc2-358a-459d-bb4f-6a68797dd16a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:34.625073 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-32424bc2-358a-459d-bb4f-6a68797dd16a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1725 microversion: 2.20 time: 0.154610 Aug 31 01:24:34.625629 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 127/256] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:24:34 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:24:34.773743 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-d6856d67-9c23-45d9-88b3-3393529897c0 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:34.774486 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-d6856d67-9c23-45d9-88b3-3393529897c0 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:34.780553 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d6856d67-9c23-45d9-88b3-3393529897c0 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:34.781171 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d6856d67-9c23-45d9-88b3-3393529897c0 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:34.781609 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d6856d67-9c23-45d9-88b3-3393529897c0 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:34.782303 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d6856d67-9c23-45d9-88b3-3393529897c0 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:34.782754 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d6856d67-9c23-45d9-88b3-3393529897c0 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:34.783177 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d6856d67-9c23-45d9-88b3-3393529897c0 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:34.916683 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-d6856d67-9c23-45d9-88b3-3393529897c0 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:34.920163 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:24:34.924640 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-d6856d67-9c23-45d9-88b3-3393529897c0 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1371 microversion: 2.1 time: 0.155340 Aug 31 01:24:34.925235 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 130/257] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:34 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:34.966769 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-c9b8780e-7267-46b5-a31c-9f2b0921b880 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:34.970404 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-c9b8780e-7267-46b5-a31c-9f2b0921b880 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 082d7637-9b1c-469c-b688-c76ca61e9f6b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:34.974195 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c9b8780e-7267-46b5-a31c-9f2b0921b880 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:34.974702 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c9b8780e-7267-46b5-a31c-9f2b0921b880 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:34.975122 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c9b8780e-7267-46b5-a31c-9f2b0921b880 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:34.975815 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c9b8780e-7267-46b5-a31c-9f2b0921b880 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:34.976327 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c9b8780e-7267-46b5-a31c-9f2b0921b880 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:34.976747 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c9b8780e-7267-46b5-a31c-9f2b0921b880 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:35.043202 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-c9b8780e-7267-46b5-a31c-9f2b0921b880 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:35.054109 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-c9b8780e-7267-46b5-a31c-9f2b0921b880 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b" status: 200 len: 1301 microversion: 2.1 time: 0.091202 Aug 31 01:24:35.055153 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 128/258] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:34 2022] GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b => generated 1301 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:35.649113 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-05213cbe-e088-4184-bb9d-8b90d5b986b2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:35.650007 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-05213cbe-e088-4184-bb9d-8b90d5b986b2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:35.663136 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-05213cbe-e088-4184-bb9d-8b90d5b986b2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:35.663136 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-05213cbe-e088-4184-bb9d-8b90d5b986b2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:35.663136 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-05213cbe-e088-4184-bb9d-8b90d5b986b2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:35.663136 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-05213cbe-e088-4184-bb9d-8b90d5b986b2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:35.663543 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-05213cbe-e088-4184-bb9d-8b90d5b986b2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:35.663543 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-05213cbe-e088-4184-bb9d-8b90d5b986b2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:35.852474 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-05213cbe-e088-4184-bb9d-8b90d5b986b2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:35.860591 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-05213cbe-e088-4184-bb9d-8b90d5b986b2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:35.862166 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-05213cbe-e088-4184-bb9d-8b90d5b986b2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:35.878142 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-05213cbe-e088-4184-bb9d-8b90d5b986b2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1725 microversion: 2.20 time: 0.219135 Aug 31 01:24:35.878142 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 131/259] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:24:35 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1725 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:24:35.944698 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-0128e10d-b179-489b-973a-5168c6cc105c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:35.945341 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-0128e10d-b179-489b-973a-5168c6cc105c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:35.947637 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell0:SELECT=2 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:24:35.948311 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell0:SELECT=12 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:24:35.953027 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0128e10d-b179-489b-973a-5168c6cc105c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:35.953576 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0128e10d-b179-489b-973a-5168c6cc105c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:35.954266 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0128e10d-b179-489b-973a-5168c6cc105c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:35.954965 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0128e10d-b179-489b-973a-5168c6cc105c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:35.955734 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0128e10d-b179-489b-973a-5168c6cc105c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:35.955839 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0128e10d-b179-489b-973a-5168c6cc105c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:36.077581 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-516fa19d-9f70-40f1-b696-a59a01577d23 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:36.078124 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-516fa19d-9f70-40f1-b696-a59a01577d23 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 082d7637-9b1c-469c-b688-c76ca61e9f6b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:36.094668 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-516fa19d-9f70-40f1-b696-a59a01577d23 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:36.095175 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-516fa19d-9f70-40f1-b696-a59a01577d23 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:36.095613 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-516fa19d-9f70-40f1-b696-a59a01577d23 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:36.096311 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-516fa19d-9f70-40f1-b696-a59a01577d23 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:36.096789 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-516fa19d-9f70-40f1-b696-a59a01577d23 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:36.097214 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-516fa19d-9f70-40f1-b696-a59a01577d23 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:36.156238 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-0128e10d-b179-489b-973a-5168c6cc105c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:36.166033 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-0128e10d-b179-489b-973a-5168c6cc105c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1371 microversion: 2.1 time: 0.225119 Aug 31 01:24:36.180048 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 129/260] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:35 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1371 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:36.181540 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell0:SELECT=12 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:24:36.296605 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-516fa19d-9f70-40f1-b696-a59a01577d23 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:36.304757 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-516fa19d-9f70-40f1-b696-a59a01577d23 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b" status: 200 len: 1367 microversion: 2.1 time: 0.231209 Aug 31 01:24:36.305644 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 132/261] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:36 2022] GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:24:36.887894 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-921593ff-9e52-46af-9e29-f92da80bcae8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:36.888667 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-921593ff-9e52-46af-9e29-f92da80bcae8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:36.895709 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-921593ff-9e52-46af-9e29-f92da80bcae8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:36.896598 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-921593ff-9e52-46af-9e29-f92da80bcae8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:36.898763 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-921593ff-9e52-46af-9e29-f92da80bcae8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:36.899800 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-921593ff-9e52-46af-9e29-f92da80bcae8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:36.900505 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-921593ff-9e52-46af-9e29-f92da80bcae8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:36.901215 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-921593ff-9e52-46af-9e29-f92da80bcae8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:37.115376 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-921593ff-9e52-46af-9e29-f92da80bcae8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:37.123614 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-921593ff-9e52-46af-9e29-f92da80bcae8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:37.125105 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-921593ff-9e52-46af-9e29-f92da80bcae8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:37.126260 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-921593ff-9e52-46af-9e29-f92da80bcae8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1725 microversion: 2.20 time: 0.242749 Aug 31 01:24:37.140905 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 130/262] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:24:36 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1725 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:24:37.187757 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-eeb31443-882d-4b14-a221-1e07c92a0132 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:37.188434 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-eeb31443-882d-4b14-a221-1e07c92a0132 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:37.195514 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-eeb31443-882d-4b14-a221-1e07c92a0132 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:37.196011 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-eeb31443-882d-4b14-a221-1e07c92a0132 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:37.196495 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-eeb31443-882d-4b14-a221-1e07c92a0132 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:37.197223 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-eeb31443-882d-4b14-a221-1e07c92a0132 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:37.197680 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-eeb31443-882d-4b14-a221-1e07c92a0132 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:37.198104 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-eeb31443-882d-4b14-a221-1e07c92a0132 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:37.289253 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-6b584b37-b16e-4c25-a38f-4a0f5b9388a3 req-acd0ce43-255b-4ed5-af60-6f8a77518b41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "082d7637-9b1c-469c-b688-c76ca61e9f6b", "tag": "3288282c-d42e-4903-85db-6161da718858"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:24:37.306194 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-6b584b37-b16e-4c25-a38f-4a0f5b9388a3 req-acd0ce43-255b-4ed5-af60-6f8a77518b41 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:37.306194 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-6b584b37-b16e-4c25-a38f-4a0f5b9388a3 req-acd0ce43-255b-4ed5-af60-6f8a77518b41 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:37.306194 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-6b584b37-b16e-4c25-a38f-4a0f5b9388a3 req-acd0ce43-255b-4ed5-af60-6f8a77518b41 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:37.318209 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-6b584b37-b16e-4c25-a38f-4a0f5b9388a3 req-acd0ce43-255b-4ed5-af60-6f8a77518b41 service nova] Creating event network-changed:3288282c-d42e-4903-85db-6161da718858 for instance 082d7637-9b1c-469c-b688-c76ca61e9f6b on hv-cinder-85528 Aug 31 01:24:37.323947 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-6b584b37-b16e-4c25-a38f-4a0f5b9388a3 req-acd0ce43-255b-4ed5-af60-6f8a77518b41 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039265 Aug 31 01:24:37.325072 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 131/263] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:24:37.332010 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-e4905c6c-b3c0-4e87-9719-d1a9392761b2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:37.332993 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-e4905c6c-b3c0-4e87-9719-d1a9392761b2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 082d7637-9b1c-469c-b688-c76ca61e9f6b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:37.346620 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e4905c6c-b3c0-4e87-9719-d1a9392761b2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:37.346620 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e4905c6c-b3c0-4e87-9719-d1a9392761b2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:37.346620 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e4905c6c-b3c0-4e87-9719-d1a9392761b2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:37.346620 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e4905c6c-b3c0-4e87-9719-d1a9392761b2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:37.346999 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e4905c6c-b3c0-4e87-9719-d1a9392761b2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:37.346999 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e4905c6c-b3c0-4e87-9719-d1a9392761b2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:37.581092 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-eeb31443-882d-4b14-a221-1e07c92a0132 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:37.592499 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-eeb31443-882d-4b14-a221-1e07c92a0132 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1371 microversion: 2.1 time: 0.407097 Aug 31 01:24:37.592499 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 133/264] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:37 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1371 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:37.634111 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-e4905c6c-b3c0-4e87-9719-d1a9392761b2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:37.642426 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-e4905c6c-b3c0-4e87-9719-d1a9392761b2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b" status: 200 len: 1367 microversion: 2.1 time: 0.316035 Aug 31 01:24:37.643015 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 132/265] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:37 2022] GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b => generated 1367 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:38.148916 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-24efcb6a-036a-4b16-a634-80da8810f097 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:38.149517 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-24efcb6a-036a-4b16-a634-80da8810f097 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:38.155572 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-24efcb6a-036a-4b16-a634-80da8810f097 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:38.162094 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-24efcb6a-036a-4b16-a634-80da8810f097 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:38.162094 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-24efcb6a-036a-4b16-a634-80da8810f097 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:38.162094 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-24efcb6a-036a-4b16-a634-80da8810f097 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:38.162094 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-24efcb6a-036a-4b16-a634-80da8810f097 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:38.162470 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-24efcb6a-036a-4b16-a634-80da8810f097 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:38.301667 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-24efcb6a-036a-4b16-a634-80da8810f097 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:38.309580 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-24efcb6a-036a-4b16-a634-80da8810f097 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:38.314425 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-24efcb6a-036a-4b16-a634-80da8810f097 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:38.314425 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-24efcb6a-036a-4b16-a634-80da8810f097 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1725 microversion: 2.20 time: 0.167279 Aug 31 01:24:38.314425 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 134/266] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:24:38 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:24:38.625508 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-ab292ccf-736a-48d0-a285-b458c2858fb5 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:38.626056 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-ab292ccf-736a-48d0-a285-b458c2858fb5 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:38.632680 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ab292ccf-736a-48d0-a285-b458c2858fb5 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:38.633204 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ab292ccf-736a-48d0-a285-b458c2858fb5 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:38.633781 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ab292ccf-736a-48d0-a285-b458c2858fb5 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:38.634515 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ab292ccf-736a-48d0-a285-b458c2858fb5 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:38.634983 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ab292ccf-736a-48d0-a285-b458c2858fb5 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:38.635438 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ab292ccf-736a-48d0-a285-b458c2858fb5 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:38.664001 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-cfe726a9-7dc9-4284-8a9b-3b94489a9fd1 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:38.664602 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-cfe726a9-7dc9-4284-8a9b-3b94489a9fd1 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 082d7637-9b1c-469c-b688-c76ca61e9f6b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:38.670954 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cfe726a9-7dc9-4284-8a9b-3b94489a9fd1 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:38.671432 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cfe726a9-7dc9-4284-8a9b-3b94489a9fd1 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:38.671855 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cfe726a9-7dc9-4284-8a9b-3b94489a9fd1 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:38.672539 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cfe726a9-7dc9-4284-8a9b-3b94489a9fd1 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:38.673013 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cfe726a9-7dc9-4284-8a9b-3b94489a9fd1 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:38.673426 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cfe726a9-7dc9-4284-8a9b-3b94489a9fd1 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:38.825221 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-ab292ccf-736a-48d0-a285-b458c2858fb5 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:38.834021 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-ab292ccf-736a-48d0-a285-b458c2858fb5 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1371 microversion: 2.1 time: 0.212543 Aug 31 01:24:38.834607 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 133/267] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:38 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1371 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:38.849076 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-cfe726a9-7dc9-4284-8a9b-3b94489a9fd1 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:38.856792 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-cfe726a9-7dc9-4284-8a9b-3b94489a9fd1 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b" status: 200 len: 1367 microversion: 2.1 time: 0.197424 Aug 31 01:24:38.857358 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 135/268] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:38 2022] GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:24:39.335595 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-0fb97e98-e5be-424b-8b72-e4877a6af2d9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:39.336516 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-0fb97e98-e5be-424b-8b72-e4877a6af2d9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:39.343247 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0fb97e98-e5be-424b-8b72-e4877a6af2d9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:39.343964 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0fb97e98-e5be-424b-8b72-e4877a6af2d9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:39.344875 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0fb97e98-e5be-424b-8b72-e4877a6af2d9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:39.346320 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0fb97e98-e5be-424b-8b72-e4877a6af2d9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:39.346863 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0fb97e98-e5be-424b-8b72-e4877a6af2d9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:39.347361 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0fb97e98-e5be-424b-8b72-e4877a6af2d9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:39.493407 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-0fb97e98-e5be-424b-8b72-e4877a6af2d9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:39.507113 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-0fb97e98-e5be-424b-8b72-e4877a6af2d9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:39.514025 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-0fb97e98-e5be-424b-8b72-e4877a6af2d9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:39.515884 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-0fb97e98-e5be-424b-8b72-e4877a6af2d9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1725 microversion: 2.20 time: 0.184918 Aug 31 01:24:39.516284 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 134/269] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:24:39 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:24:39.611203 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [req-b7246bb3-996e-4021-8ade-7297f2a1ea1d req-2288211d-3778-4d43-a97d-ee73291b7431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "380077d1-0ed7-47ac-9e19-5425164e6da1", "name": "network-vif-plugged", "status": "completed", "tag": "6715d43f-3649-46e9-b421-5ed74efa38b9"}]} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:24:39.621645 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-b7246bb3-996e-4021-8ade-7297f2a1ea1d req-2288211d-3778-4d43-a97d-ee73291b7431 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:39.622120 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-b7246bb3-996e-4021-8ade-7297f2a1ea1d req-2288211d-3778-4d43-a97d-ee73291b7431 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:39.622553 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-b7246bb3-996e-4021-8ade-7297f2a1ea1d req-2288211d-3778-4d43-a97d-ee73291b7431 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:39.633345 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.compute.server_external_events [req-b7246bb3-996e-4021-8ade-7297f2a1ea1d req-2288211d-3778-4d43-a97d-ee73291b7431 service nova] Creating event network-vif-plugged:6715d43f-3649-46e9-b421-5ed74efa38b9 for instance 380077d1-0ed7-47ac-9e19-5425164e6da1 on hv-cinder-85528 Aug 31 01:24:39.638344 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [req-b7246bb3-996e-4021-8ade-7297f2a1ea1d req-2288211d-3778-4d43-a97d-ee73291b7431 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030947 Aug 31 01:24:39.638906 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 136/270] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:24:39.854454 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-71cc5d97-4d0f-4bf9-960e-2d0de2bcc09c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:39.855064 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-71cc5d97-4d0f-4bf9-960e-2d0de2bcc09c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:39.861161 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-71cc5d97-4d0f-4bf9-960e-2d0de2bcc09c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:39.861703 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-71cc5d97-4d0f-4bf9-960e-2d0de2bcc09c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:39.862142 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-71cc5d97-4d0f-4bf9-960e-2d0de2bcc09c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:39.862870 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-71cc5d97-4d0f-4bf9-960e-2d0de2bcc09c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:39.863852 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-71cc5d97-4d0f-4bf9-960e-2d0de2bcc09c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:39.864272 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-71cc5d97-4d0f-4bf9-960e-2d0de2bcc09c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:39.877932 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-f7ce08f6-7417-4ee5-8a7b-fe415fd0a5b7 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:39.878639 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-f7ce08f6-7417-4ee5-8a7b-fe415fd0a5b7 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 082d7637-9b1c-469c-b688-c76ca61e9f6b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:39.884740 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f7ce08f6-7417-4ee5-8a7b-fe415fd0a5b7 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:39.885252 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f7ce08f6-7417-4ee5-8a7b-fe415fd0a5b7 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:39.885686 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f7ce08f6-7417-4ee5-8a7b-fe415fd0a5b7 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:39.886406 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f7ce08f6-7417-4ee5-8a7b-fe415fd0a5b7 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:39.886859 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f7ce08f6-7417-4ee5-8a7b-fe415fd0a5b7 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:39.887281 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f7ce08f6-7417-4ee5-8a7b-fe415fd0a5b7 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:40.087257 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-71cc5d97-4d0f-4bf9-960e-2d0de2bcc09c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:40.090265 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-f7ce08f6-7417-4ee5-8a7b-fe415fd0a5b7 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:40.098262 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-71cc5d97-4d0f-4bf9-960e-2d0de2bcc09c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1371 microversion: 2.1 time: 0.247105 Aug 31 01:24:40.098781 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-f7ce08f6-7417-4ee5-8a7b-fe415fd0a5b7 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b" status: 200 len: 1367 microversion: 2.1 time: 0.224997 Aug 31 01:24:40.099171 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 135/271] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:39 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1371 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:40.099820 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 137/272] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:39 2022] GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:24:40.538599 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-8ac19ef2-a5dd-4b1d-8b67-80cce3647c61 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:40.539209 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-8ac19ef2-a5dd-4b1d-8b67-80cce3647c61 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:40.544967 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8ac19ef2-a5dd-4b1d-8b67-80cce3647c61 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:40.545439 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8ac19ef2-a5dd-4b1d-8b67-80cce3647c61 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:40.545898 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8ac19ef2-a5dd-4b1d-8b67-80cce3647c61 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:40.548632 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8ac19ef2-a5dd-4b1d-8b67-80cce3647c61 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:40.548632 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8ac19ef2-a5dd-4b1d-8b67-80cce3647c61 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:40.548632 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8ac19ef2-a5dd-4b1d-8b67-80cce3647c61 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:40.678021 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-8ac19ef2-a5dd-4b1d-8b67-80cce3647c61 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:40.686208 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-8ac19ef2-a5dd-4b1d-8b67-80cce3647c61 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:40.687635 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-8ac19ef2-a5dd-4b1d-8b67-80cce3647c61 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:40.688805 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-8ac19ef2-a5dd-4b1d-8b67-80cce3647c61 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1725 microversion: 2.20 time: 0.154582 Aug 31 01:24:40.689371 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 136/273] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:24:40 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:24:41.118971 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-24ee4fe2-3a9a-49a6-90be-89396bd6ea1b tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:41.119491 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-79a9e86d-93db-4046-96cf-fbdaa9407b35 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:41.119848 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-24ee4fe2-3a9a-49a6-90be-89396bd6ea1b tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:41.119954 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-79a9e86d-93db-4046-96cf-fbdaa9407b35 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 082d7637-9b1c-469c-b688-c76ca61e9f6b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:41.125476 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-24ee4fe2-3a9a-49a6-90be-89396bd6ea1b tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:41.125863 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-79a9e86d-93db-4046-96cf-fbdaa9407b35 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:41.125965 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-24ee4fe2-3a9a-49a6-90be-89396bd6ea1b tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:41.126342 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-79a9e86d-93db-4046-96cf-fbdaa9407b35 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:41.126464 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-24ee4fe2-3a9a-49a6-90be-89396bd6ea1b tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:41.126767 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-79a9e86d-93db-4046-96cf-fbdaa9407b35 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:41.127144 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-24ee4fe2-3a9a-49a6-90be-89396bd6ea1b tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:41.127451 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-79a9e86d-93db-4046-96cf-fbdaa9407b35 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:41.127594 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-24ee4fe2-3a9a-49a6-90be-89396bd6ea1b tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:41.127894 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-79a9e86d-93db-4046-96cf-fbdaa9407b35 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:41.128012 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-24ee4fe2-3a9a-49a6-90be-89396bd6ea1b tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:41.128305 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-79a9e86d-93db-4046-96cf-fbdaa9407b35 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:41.319988 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-24ee4fe2-3a9a-49a6-90be-89396bd6ea1b tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:41.323957 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-79a9e86d-93db-4046-96cf-fbdaa9407b35 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:41.327732 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-24ee4fe2-3a9a-49a6-90be-89396bd6ea1b tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1371 microversion: 2.1 time: 0.212897 Aug 31 01:24:41.328299 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 138/274] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:41 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1371 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:41.332583 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-79a9e86d-93db-4046-96cf-fbdaa9407b35 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b" status: 200 len: 1367 microversion: 2.1 time: 0.217191 Aug 31 01:24:41.333165 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 137/275] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:41 2022] GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:24:41.711715 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-24326f66-13b9-4dcf-a3ed-6a7a93971242 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:41.712353 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-24326f66-13b9-4dcf-a3ed-6a7a93971242 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:41.718414 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-24326f66-13b9-4dcf-a3ed-6a7a93971242 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:41.718895 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-24326f66-13b9-4dcf-a3ed-6a7a93971242 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:41.719410 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-24326f66-13b9-4dcf-a3ed-6a7a93971242 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:41.720104 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-24326f66-13b9-4dcf-a3ed-6a7a93971242 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:41.720560 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-24326f66-13b9-4dcf-a3ed-6a7a93971242 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:41.721007 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-24326f66-13b9-4dcf-a3ed-6a7a93971242 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:41.848848 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-24326f66-13b9-4dcf-a3ed-6a7a93971242 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:41.857311 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-24326f66-13b9-4dcf-a3ed-6a7a93971242 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:41.858780 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-24326f66-13b9-4dcf-a3ed-6a7a93971242 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:41.859948 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-24326f66-13b9-4dcf-a3ed-6a7a93971242 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1725 microversion: 2.20 time: 0.152358 Aug 31 01:24:41.870184 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 139/276] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:24:41 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:24:42.349475 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-475259aa-9fa8-43fa-964f-8794c1bb4926 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:42.350002 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-475259aa-9fa8-43fa-964f-8794c1bb4926 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:42.353483 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-5c30c696-daf9-4b0d-81ad-e9bc6b7ecfeb tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:42.354093 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-5c30c696-daf9-4b0d-81ad-e9bc6b7ecfeb tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 082d7637-9b1c-469c-b688-c76ca61e9f6b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:42.356451 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-475259aa-9fa8-43fa-964f-8794c1bb4926 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:42.356967 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-475259aa-9fa8-43fa-964f-8794c1bb4926 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:42.357393 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-475259aa-9fa8-43fa-964f-8794c1bb4926 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:42.358071 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-475259aa-9fa8-43fa-964f-8794c1bb4926 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:42.358512 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-475259aa-9fa8-43fa-964f-8794c1bb4926 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:42.358926 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-475259aa-9fa8-43fa-964f-8794c1bb4926 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:42.360506 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5c30c696-daf9-4b0d-81ad-e9bc6b7ecfeb tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:42.361083 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5c30c696-daf9-4b0d-81ad-e9bc6b7ecfeb tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:42.361520 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5c30c696-daf9-4b0d-81ad-e9bc6b7ecfeb tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:42.362200 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5c30c696-daf9-4b0d-81ad-e9bc6b7ecfeb tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:42.362648 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5c30c696-daf9-4b0d-81ad-e9bc6b7ecfeb tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:42.363063 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5c30c696-daf9-4b0d-81ad-e9bc6b7ecfeb tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:42.551284 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-475259aa-9fa8-43fa-964f-8794c1bb4926 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:42.554617 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-5c30c696-daf9-4b0d-81ad-e9bc6b7ecfeb tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:42.560898 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-475259aa-9fa8-43fa-964f-8794c1bb4926 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1371 microversion: 2.1 time: 0.215804 Aug 31 01:24:42.561469 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 138/277] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:42 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1371 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:42.562468 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-5c30c696-daf9-4b0d-81ad-e9bc6b7ecfeb tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b" status: 200 len: 1367 microversion: 2.1 time: 0.212811 Aug 31 01:24:42.563030 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 140/278] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:42 2022] GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:42.898799 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-1bab89a3-0e13-46d0-bf4f-3fa4017a5702 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:42.899773 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-1bab89a3-0e13-46d0-bf4f-3fa4017a5702 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:42.906998 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1bab89a3-0e13-46d0-bf4f-3fa4017a5702 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:42.907596 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1bab89a3-0e13-46d0-bf4f-3fa4017a5702 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:42.908105 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1bab89a3-0e13-46d0-bf4f-3fa4017a5702 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:42.908919 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1bab89a3-0e13-46d0-bf4f-3fa4017a5702 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:42.909443 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1bab89a3-0e13-46d0-bf4f-3fa4017a5702 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:42.909939 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1bab89a3-0e13-46d0-bf4f-3fa4017a5702 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:42.924873 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell1:SELECT=100 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:24:43.041648 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-1bab89a3-0e13-46d0-bf4f-3fa4017a5702 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:43.049608 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-1bab89a3-0e13-46d0-bf4f-3fa4017a5702 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:43.051537 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-1bab89a3-0e13-46d0-bf4f-3fa4017a5702 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:43.052698 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-1bab89a3-0e13-46d0-bf4f-3fa4017a5702 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1725 microversion: 2.20 time: 0.158779 Aug 31 01:24:43.053291 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 139/279] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:24:42 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:24:43.582229 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-7d8c42ca-51bb-4e23-a249-12128abe7b30 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:43.582835 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-7d8c42ca-51bb-4e23-a249-12128abe7b30 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:43.583750 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-0903d973-337b-4e7d-bdfd-d9d09e71fb1e tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:43.584421 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-0903d973-337b-4e7d-bdfd-d9d09e71fb1e tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 082d7637-9b1c-469c-b688-c76ca61e9f6b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:43.589538 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7d8c42ca-51bb-4e23-a249-12128abe7b30 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:43.590022 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7d8c42ca-51bb-4e23-a249-12128abe7b30 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:43.590459 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7d8c42ca-51bb-4e23-a249-12128abe7b30 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:43.590939 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0903d973-337b-4e7d-bdfd-d9d09e71fb1e tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:43.591157 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7d8c42ca-51bb-4e23-a249-12128abe7b30 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:43.591411 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0903d973-337b-4e7d-bdfd-d9d09e71fb1e tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:43.591610 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7d8c42ca-51bb-4e23-a249-12128abe7b30 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:43.591835 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0903d973-337b-4e7d-bdfd-d9d09e71fb1e tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:43.592028 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7d8c42ca-51bb-4e23-a249-12128abe7b30 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:43.592511 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0903d973-337b-4e7d-bdfd-d9d09e71fb1e tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:43.593039 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0903d973-337b-4e7d-bdfd-d9d09e71fb1e tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:43.593448 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0903d973-337b-4e7d-bdfd-d9d09e71fb1e tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:43.787553 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-0903d973-337b-4e7d-bdfd-d9d09e71fb1e tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:43.802436 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-7d8c42ca-51bb-4e23-a249-12128abe7b30 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:43.802596 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-0903d973-337b-4e7d-bdfd-d9d09e71fb1e tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b" status: 200 len: 1367 microversion: 2.1 time: 0.216029 Aug 31 01:24:43.802596 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 140/280] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:43 2022] GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:43.802960 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-7d8c42ca-51bb-4e23-a249-12128abe7b30 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1371 microversion: 2.1 time: 0.224071 Aug 31 01:24:43.802960 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 141/281] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:43 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1371 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:44.075886 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-61a48bca-7aa2-42ff-b32a-735396ba425f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:44.076470 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-61a48bca-7aa2-42ff-b32a-735396ba425f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:44.083226 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-61a48bca-7aa2-42ff-b32a-735396ba425f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:44.083708 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-61a48bca-7aa2-42ff-b32a-735396ba425f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:44.084141 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-61a48bca-7aa2-42ff-b32a-735396ba425f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:44.084842 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-61a48bca-7aa2-42ff-b32a-735396ba425f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:44.085326 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-61a48bca-7aa2-42ff-b32a-735396ba425f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:44.085735 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-61a48bca-7aa2-42ff-b32a-735396ba425f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:44.220899 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-61a48bca-7aa2-42ff-b32a-735396ba425f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:44.232219 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-61a48bca-7aa2-42ff-b32a-735396ba425f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:44.232219 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-61a48bca-7aa2-42ff-b32a-735396ba425f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:44.232219 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-61a48bca-7aa2-42ff-b32a-735396ba425f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1725 microversion: 2.20 time: 0.160044 Aug 31 01:24:44.232639 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 141/282] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:24:44 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:24:44.817130 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-be8e8ced-3bd4-42b7-ad64-cb78d70b1940 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:44.817797 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-be8e8ced-3bd4-42b7-ad64-cb78d70b1940 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 082d7637-9b1c-469c-b688-c76ca61e9f6b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:44.822757 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-92f14ebb-6b94-4e75-8481-c91d6407ef75 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:44.823255 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-92f14ebb-6b94-4e75-8481-c91d6407ef75 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:44.824096 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-be8e8ced-3bd4-42b7-ad64-cb78d70b1940 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:44.824580 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-be8e8ced-3bd4-42b7-ad64-cb78d70b1940 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:44.825049 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-be8e8ced-3bd4-42b7-ad64-cb78d70b1940 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:44.825736 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-be8e8ced-3bd4-42b7-ad64-cb78d70b1940 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:44.826185 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-be8e8ced-3bd4-42b7-ad64-cb78d70b1940 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:44.826605 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-be8e8ced-3bd4-42b7-ad64-cb78d70b1940 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:44.829757 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-92f14ebb-6b94-4e75-8481-c91d6407ef75 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:44.830229 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-92f14ebb-6b94-4e75-8481-c91d6407ef75 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:44.830722 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-92f14ebb-6b94-4e75-8481-c91d6407ef75 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:44.831410 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-92f14ebb-6b94-4e75-8481-c91d6407ef75 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:44.831855 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-92f14ebb-6b94-4e75-8481-c91d6407ef75 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:44.832861 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-92f14ebb-6b94-4e75-8481-c91d6407ef75 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:45.018608 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-be8e8ced-3bd4-42b7-ad64-cb78d70b1940 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:45.022173 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-92f14ebb-6b94-4e75-8481-c91d6407ef75 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:45.026893 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-be8e8ced-3bd4-42b7-ad64-cb78d70b1940 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b" status: 200 len: 1367 microversion: 2.1 time: 0.214104 Aug 31 01:24:45.027468 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 142/283] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:44 2022] GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:45.029624 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-92f14ebb-6b94-4e75-8481-c91d6407ef75 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1371 microversion: 2.1 time: 0.210715 Aug 31 01:24:45.030199 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 142/284] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:44 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1371 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:45.255489 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-8bcaae38-fc4e-472a-a12a-ec38edacd2b2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:45.256094 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-8bcaae38-fc4e-472a-a12a-ec38edacd2b2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:45.261994 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8bcaae38-fc4e-472a-a12a-ec38edacd2b2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:45.262477 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8bcaae38-fc4e-472a-a12a-ec38edacd2b2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:45.262912 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8bcaae38-fc4e-472a-a12a-ec38edacd2b2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:45.263602 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8bcaae38-fc4e-472a-a12a-ec38edacd2b2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:45.264056 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8bcaae38-fc4e-472a-a12a-ec38edacd2b2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:45.264477 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8bcaae38-fc4e-472a-a12a-ec38edacd2b2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:45.395299 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-8bcaae38-fc4e-472a-a12a-ec38edacd2b2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:45.403695 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-8bcaae38-fc4e-472a-a12a-ec38edacd2b2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:45.405159 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-8bcaae38-fc4e-472a-a12a-ec38edacd2b2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:45.406313 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-8bcaae38-fc4e-472a-a12a-ec38edacd2b2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1725 microversion: 2.20 time: 0.155326 Aug 31 01:24:45.406871 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 143/285] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:24:45 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:24:46.047666 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-7e3fe4eb-1e4d-41a4-ba39-be1094c21bfd tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:46.048260 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-7e3fe4eb-1e4d-41a4-ba39-be1094c21bfd tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 082d7637-9b1c-469c-b688-c76ca61e9f6b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:46.049420 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-963e80be-59d2-4ed4-a771-fd1a974da58c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:46.050033 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-963e80be-59d2-4ed4-a771-fd1a974da58c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:46.055321 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7e3fe4eb-1e4d-41a4-ba39-be1094c21bfd tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:46.055801 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7e3fe4eb-1e4d-41a4-ba39-be1094c21bfd tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:46.056233 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7e3fe4eb-1e4d-41a4-ba39-be1094c21bfd tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:46.056953 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7e3fe4eb-1e4d-41a4-ba39-be1094c21bfd tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:46.057125 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-963e80be-59d2-4ed4-a771-fd1a974da58c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:46.057436 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7e3fe4eb-1e4d-41a4-ba39-be1094c21bfd tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:46.057608 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-963e80be-59d2-4ed4-a771-fd1a974da58c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:46.057853 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7e3fe4eb-1e4d-41a4-ba39-be1094c21bfd tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:46.058151 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-963e80be-59d2-4ed4-a771-fd1a974da58c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:46.058852 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-963e80be-59d2-4ed4-a771-fd1a974da58c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:46.059305 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-963e80be-59d2-4ed4-a771-fd1a974da58c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:46.059726 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-963e80be-59d2-4ed4-a771-fd1a974da58c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:46.486183 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-963e80be-59d2-4ed4-a771-fd1a974da58c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:46.488916 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-7e3fe4eb-1e4d-41a4-ba39-be1094c21bfd tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:46.494411 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-963e80be-59d2-4ed4-a771-fd1a974da58c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1371 microversion: 2.1 time: 0.448704 Aug 31 01:24:46.495130 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 144/286] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:46 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1371 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:24:46.496546 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-7e3fe4eb-1e4d-41a4-ba39-be1094c21bfd tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b" status: 200 len: 1367 microversion: 2.1 time: 0.452727 Aug 31 01:24:46.497275 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 143/287] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:46 2022] GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b => generated 1367 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:46.500086 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-ccd67f84-4c47-49f0-a902-f288842b98b1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:46.500679 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-ccd67f84-4c47-49f0-a902-f288842b98b1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:46.506339 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ccd67f84-4c47-49f0-a902-f288842b98b1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:46.506801 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ccd67f84-4c47-49f0-a902-f288842b98b1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:46.507340 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ccd67f84-4c47-49f0-a902-f288842b98b1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:46.508021 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ccd67f84-4c47-49f0-a902-f288842b98b1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:46.508493 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ccd67f84-4c47-49f0-a902-f288842b98b1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:46.508934 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ccd67f84-4c47-49f0-a902-f288842b98b1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:46.634663 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-ccd67f84-4c47-49f0-a902-f288842b98b1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:46.642902 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-ccd67f84-4c47-49f0-a902-f288842b98b1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:46.644331 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-ccd67f84-4c47-49f0-a902-f288842b98b1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:46.646113 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-ccd67f84-4c47-49f0-a902-f288842b98b1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1725 microversion: 2.20 time: 0.149372 Aug 31 01:24:46.646684 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 145/288] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:24:46 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:24:46.822885 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-e8a1f6a2-a42d-44ff-8808-2037e6366ad7 req-7cb876d9-43ab-4dcf-8b12-0c6a4c153617 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "082d7637-9b1c-469c-b688-c76ca61e9f6b", "name": "network-vif-plugged", "status": "completed", "tag": "3288282c-d42e-4903-85db-6161da718858"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:24:46.832685 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-e8a1f6a2-a42d-44ff-8808-2037e6366ad7 req-7cb876d9-43ab-4dcf-8b12-0c6a4c153617 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:46.833906 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-e8a1f6a2-a42d-44ff-8808-2037e6366ad7 req-7cb876d9-43ab-4dcf-8b12-0c6a4c153617 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:46.834933 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-e8a1f6a2-a42d-44ff-8808-2037e6366ad7 req-7cb876d9-43ab-4dcf-8b12-0c6a4c153617 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:46.846058 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-e8a1f6a2-a42d-44ff-8808-2037e6366ad7 req-7cb876d9-43ab-4dcf-8b12-0c6a4c153617 service nova] Creating event network-vif-plugged:3288282c-d42e-4903-85db-6161da718858 for instance 082d7637-9b1c-469c-b688-c76ca61e9f6b on hv-cinder-85528 Aug 31 01:24:46.851843 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-e8a1f6a2-a42d-44ff-8808-2037e6366ad7 req-7cb876d9-43ab-4dcf-8b12-0c6a4c153617 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032754 Aug 31 01:24:46.852504 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 144/289] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:24:47.516075 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-76b404e1-ec20-49da-a264-66ba23f0083e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:47.516891 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-76b404e1-ec20-49da-a264-66ba23f0083e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:47.517517 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-904afae7-a205-4188-9cfe-65000f352e22 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:47.518226 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-904afae7-a205-4188-9cfe-65000f352e22 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 082d7637-9b1c-469c-b688-c76ca61e9f6b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:47.523864 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-76b404e1-ec20-49da-a264-66ba23f0083e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:47.524464 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-76b404e1-ec20-49da-a264-66ba23f0083e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:47.525032 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-76b404e1-ec20-49da-a264-66ba23f0083e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:47.525150 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-904afae7-a205-4188-9cfe-65000f352e22 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:47.525567 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-904afae7-a205-4188-9cfe-65000f352e22 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:47.526006 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-904afae7-a205-4188-9cfe-65000f352e22 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:47.526116 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-76b404e1-ec20-49da-a264-66ba23f0083e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:47.526633 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-76b404e1-ec20-49da-a264-66ba23f0083e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:47.526737 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-904afae7-a205-4188-9cfe-65000f352e22 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:47.527174 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-904afae7-a205-4188-9cfe-65000f352e22 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:47.527308 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-76b404e1-ec20-49da-a264-66ba23f0083e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:47.527599 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-904afae7-a205-4188-9cfe-65000f352e22 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:47.722531 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-76b404e1-ec20-49da-a264-66ba23f0083e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:47.727540 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-904afae7-a205-4188-9cfe-65000f352e22 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:47.731212 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-76b404e1-ec20-49da-a264-66ba23f0083e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1566 microversion: 2.1 time: 0.220057 Aug 31 01:24:47.737071 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-904afae7-a205-4188-9cfe-65000f352e22 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b" status: 200 len: 1367 microversion: 2.1 time: 0.223902 Aug 31 01:24:47.737846 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 145/290] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:47 2022] GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:24:47.743408 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-5747f7ad-837d-4b94-b1ab-1ad0b716c2ce tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:47.744405 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 146/291] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:47 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1566 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:47.744953 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-5747f7ad-837d-4b94-b1ab-1ad0b716c2ce tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:47.752466 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-912eccf5-0970-4af4-8a73-78b9a72b26b1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:47.752993 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-912eccf5-0970-4af4-8a73-78b9a72b26b1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:47.753145 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5747f7ad-837d-4b94-b1ab-1ad0b716c2ce tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:47.753781 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5747f7ad-837d-4b94-b1ab-1ad0b716c2ce tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:47.754226 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5747f7ad-837d-4b94-b1ab-1ad0b716c2ce tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:47.755025 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5747f7ad-837d-4b94-b1ab-1ad0b716c2ce tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:47.755517 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5747f7ad-837d-4b94-b1ab-1ad0b716c2ce tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:47.755923 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5747f7ad-837d-4b94-b1ab-1ad0b716c2ce tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:47.759030 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-912eccf5-0970-4af4-8a73-78b9a72b26b1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:47.759508 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-912eccf5-0970-4af4-8a73-78b9a72b26b1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:47.759947 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-912eccf5-0970-4af4-8a73-78b9a72b26b1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:47.760638 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-912eccf5-0970-4af4-8a73-78b9a72b26b1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:47.761125 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-912eccf5-0970-4af4-8a73-78b9a72b26b1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:47.761547 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-912eccf5-0970-4af4-8a73-78b9a72b26b1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:47.889919 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-912eccf5-0970-4af4-8a73-78b9a72b26b1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.141327 Aug 31 01:24:47.890509 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 147/292] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Aug 31 01:24:47 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1/os-interface => generated 285 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:24:47.974548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-5747f7ad-837d-4b94-b1ab-1ad0b716c2ce tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:47.983068 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-5747f7ad-837d-4b94-b1ab-1ad0b716c2ce tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:47.984782 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-5747f7ad-837d-4b94-b1ab-1ad0b716c2ce tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:47.985987 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-5747f7ad-837d-4b94-b1ab-1ad0b716c2ce tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1725 microversion: 2.20 time: 0.246996 Aug 31 01:24:47.988992 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 146/293] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:24:47 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1725 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:24:48.759848 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-3380af4c-ff2e-411c-a51b-c30c3d7a19ae tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:48.760628 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-3380af4c-ff2e-411c-a51b-c30c3d7a19ae tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 082d7637-9b1c-469c-b688-c76ca61e9f6b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:48.768584 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3380af4c-ff2e-411c-a51b-c30c3d7a19ae tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:48.781857 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3380af4c-ff2e-411c-a51b-c30c3d7a19ae tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:48.781857 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3380af4c-ff2e-411c-a51b-c30c3d7a19ae tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:48.781857 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3380af4c-ff2e-411c-a51b-c30c3d7a19ae tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:48.781857 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3380af4c-ff2e-411c-a51b-c30c3d7a19ae tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:48.782246 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3380af4c-ff2e-411c-a51b-c30c3d7a19ae tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:48.789540 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell1:SELECT=100 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:24:48.907671 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-3380af4c-ff2e-411c-a51b-c30c3d7a19ae tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:48.915785 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-3380af4c-ff2e-411c-a51b-c30c3d7a19ae tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b" status: 200 len: 1367 microversion: 2.1 time: 0.161100 Aug 31 01:24:48.919060 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 148/294] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:48 2022] GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:49.008924 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-2b4e3af2-a320-475f-888f-b841d1d24dd5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:49.010624 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-2b4e3af2-a320-475f-888f-b841d1d24dd5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:49.018804 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2b4e3af2-a320-475f-888f-b841d1d24dd5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:49.018804 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2b4e3af2-a320-475f-888f-b841d1d24dd5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:49.019085 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2b4e3af2-a320-475f-888f-b841d1d24dd5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:49.020188 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2b4e3af2-a320-475f-888f-b841d1d24dd5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:49.020545 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2b4e3af2-a320-475f-888f-b841d1d24dd5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:49.021017 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2b4e3af2-a320-475f-888f-b841d1d24dd5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:49.107176 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [req-003322b2-c443-49fd-a934-d5fe5ec9fa76 req-fc8ecfe5-a061-4292-9992-ba700f9eadce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "380077d1-0ed7-47ac-9e19-5425164e6da1", "tag": "6715d43f-3649-46e9-b421-5ed74efa38b9"}]} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:24:49.118793 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-003322b2-c443-49fd-a934-d5fe5ec9fa76 req-fc8ecfe5-a061-4292-9992-ba700f9eadce service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:49.128936 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-003322b2-c443-49fd-a934-d5fe5ec9fa76 req-fc8ecfe5-a061-4292-9992-ba700f9eadce service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:49.128936 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-003322b2-c443-49fd-a934-d5fe5ec9fa76 req-fc8ecfe5-a061-4292-9992-ba700f9eadce service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:49.132502 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.compute.server_external_events [req-003322b2-c443-49fd-a934-d5fe5ec9fa76 req-fc8ecfe5-a061-4292-9992-ba700f9eadce service nova] Creating event network-changed:6715d43f-3649-46e9-b421-5ed74efa38b9 for instance 380077d1-0ed7-47ac-9e19-5425164e6da1 on hv-cinder-85528 Aug 31 01:24:49.138122 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [req-003322b2-c443-49fd-a934-d5fe5ec9fa76 req-fc8ecfe5-a061-4292-9992-ba700f9eadce service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034574 Aug 31 01:24:49.139126 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 149/295] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:24:49.177306 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-2b4e3af2-a320-475f-888f-b841d1d24dd5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:49.177306 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-2b4e3af2-a320-475f-888f-b841d1d24dd5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:49.186301 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-2b4e3af2-a320-475f-888f-b841d1d24dd5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:49.187535 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-2b4e3af2-a320-475f-888f-b841d1d24dd5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1725 microversion: 2.20 time: 0.182661 Aug 31 01:24:49.188231 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 147/296] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:24:49 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1725 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:24:49.938717 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-9216dcf9-674e-46e3-b759-3764fa87593f tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:49.939353 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-9216dcf9-674e-46e3-b759-3764fa87593f tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 082d7637-9b1c-469c-b688-c76ca61e9f6b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:49.946923 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9216dcf9-674e-46e3-b759-3764fa87593f tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:49.947415 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9216dcf9-674e-46e3-b759-3764fa87593f tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:49.947910 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9216dcf9-674e-46e3-b759-3764fa87593f tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:49.948617 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9216dcf9-674e-46e3-b759-3764fa87593f tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:49.949110 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9216dcf9-674e-46e3-b759-3764fa87593f tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:49.949534 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9216dcf9-674e-46e3-b759-3764fa87593f tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:50.211200 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-94c13149-03de-4447-860b-67bc493f5bc6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:50.212699 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-94c13149-03de-4447-860b-67bc493f5bc6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:50.224878 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-94c13149-03de-4447-860b-67bc493f5bc6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:50.226186 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-94c13149-03de-4447-860b-67bc493f5bc6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:50.226710 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-94c13149-03de-4447-860b-67bc493f5bc6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:50.227544 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-94c13149-03de-4447-860b-67bc493f5bc6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:50.228112 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-94c13149-03de-4447-860b-67bc493f5bc6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:50.233770 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-94c13149-03de-4447-860b-67bc493f5bc6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:50.284240 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-9216dcf9-674e-46e3-b759-3764fa87593f tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:50.297265 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-9216dcf9-674e-46e3-b759-3764fa87593f tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b" status: 200 len: 1367 microversion: 2.1 time: 0.363282 Aug 31 01:24:50.298068 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 150/297] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:49 2022] GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b => generated 1367 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:24:50.483487 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-94c13149-03de-4447-860b-67bc493f5bc6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:50.500674 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-94c13149-03de-4447-860b-67bc493f5bc6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:50.500674 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-94c13149-03de-4447-860b-67bc493f5bc6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:50.500674 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-94c13149-03de-4447-860b-67bc493f5bc6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1725 microversion: 2.20 time: 0.289020 Aug 31 01:24:50.501008 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 148/298] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:24:50 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1725 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 01:24:51.329373 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-9ccb0021-f29e-405e-b16a-73d4b3d88076 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:51.329927 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-9ccb0021-f29e-405e-b16a-73d4b3d88076 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 082d7637-9b1c-469c-b688-c76ca61e9f6b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:51.336299 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9ccb0021-f29e-405e-b16a-73d4b3d88076 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:51.336821 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9ccb0021-f29e-405e-b16a-73d4b3d88076 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:51.337258 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9ccb0021-f29e-405e-b16a-73d4b3d88076 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:51.337943 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9ccb0021-f29e-405e-b16a-73d4b3d88076 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:51.338392 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9ccb0021-f29e-405e-b16a-73d4b3d88076 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:51.338811 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9ccb0021-f29e-405e-b16a-73d4b3d88076 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:51.465124 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-9ccb0021-f29e-405e-b16a-73d4b3d88076 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:51.472741 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-9ccb0021-f29e-405e-b16a-73d4b3d88076 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b" status: 200 len: 1556 microversion: 2.1 time: 0.147677 Aug 31 01:24:51.473815 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 151/299] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:51 2022] GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b => generated 1556 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:51.493733 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-8c73e1cf-301f-4ec2-a645-b8562eebc5a2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:51.494227 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-8c73e1cf-301f-4ec2-a645-b8562eebc5a2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 082d7637-9b1c-469c-b688-c76ca61e9f6b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:51.500636 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8c73e1cf-301f-4ec2-a645-b8562eebc5a2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:51.501155 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8c73e1cf-301f-4ec2-a645-b8562eebc5a2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:51.501590 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8c73e1cf-301f-4ec2-a645-b8562eebc5a2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:51.502279 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8c73e1cf-301f-4ec2-a645-b8562eebc5a2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:51.502734 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8c73e1cf-301f-4ec2-a645-b8562eebc5a2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:51.503157 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8c73e1cf-301f-4ec2-a645-b8562eebc5a2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:51.520695 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-3ca07b28-a664-4455-976f-9bf1cd68f8ab tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:51.521333 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-3ca07b28-a664-4455-976f-9bf1cd68f8ab tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:51.527203 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3ca07b28-a664-4455-976f-9bf1cd68f8ab tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:51.528140 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3ca07b28-a664-4455-976f-9bf1cd68f8ab tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:51.528581 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3ca07b28-a664-4455-976f-9bf1cd68f8ab tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:51.529370 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3ca07b28-a664-4455-976f-9bf1cd68f8ab tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:51.529987 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3ca07b28-a664-4455-976f-9bf1cd68f8ab tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:51.530411 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3ca07b28-a664-4455-976f-9bf1cd68f8ab tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:51.619854 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-8c73e1cf-301f-4ec2-a645-b8562eebc5a2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.130512 Aug 31 01:24:51.620662 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 149/300] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Aug 31 01:24:51 2022] GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b/os-interface => generated 284 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:24:51.683745 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-3ca07b28-a664-4455-976f-9bf1cd68f8ab tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:51.692162 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-3ca07b28-a664-4455-976f-9bf1cd68f8ab tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:51.693618 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-3ca07b28-a664-4455-976f-9bf1cd68f8ab tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:51.694765 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-3ca07b28-a664-4455-976f-9bf1cd68f8ab tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1725 microversion: 2.20 time: 0.177944 Aug 31 01:24:51.695481 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 152/301] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:24:51 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 01:24:52.612264 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-055302e7-de06-4262-922f-e96dcc0d5d38 req-4c40fd72-50f6-4623-92e2-3c0118c02d08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "082d7637-9b1c-469c-b688-c76ca61e9f6b", "tag": "3288282c-d42e-4903-85db-6161da718858"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:24:52.622483 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-055302e7-de06-4262-922f-e96dcc0d5d38 req-4c40fd72-50f6-4623-92e2-3c0118c02d08 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:52.622967 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-055302e7-de06-4262-922f-e96dcc0d5d38 req-4c40fd72-50f6-4623-92e2-3c0118c02d08 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:52.623430 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-055302e7-de06-4262-922f-e96dcc0d5d38 req-4c40fd72-50f6-4623-92e2-3c0118c02d08 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:52.634653 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-055302e7-de06-4262-922f-e96dcc0d5d38 req-4c40fd72-50f6-4623-92e2-3c0118c02d08 service nova] Creating event network-changed:3288282c-d42e-4903-85db-6161da718858 for instance 082d7637-9b1c-469c-b688-c76ca61e9f6b on hv-cinder-85528 Aug 31 01:24:52.639551 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-055302e7-de06-4262-922f-e96dcc0d5d38 req-4c40fd72-50f6-4623-92e2-3c0118c02d08 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030807 Aug 31 01:24:52.640585 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 150/302] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:24:52.718653 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-704499ea-6549-4e26-b2b8-e48e2b79a116 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:52.719296 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-704499ea-6549-4e26-b2b8-e48e2b79a116 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:52.725689 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-704499ea-6549-4e26-b2b8-e48e2b79a116 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:52.726168 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-704499ea-6549-4e26-b2b8-e48e2b79a116 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:52.726589 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-704499ea-6549-4e26-b2b8-e48e2b79a116 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:52.727461 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-704499ea-6549-4e26-b2b8-e48e2b79a116 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:52.728063 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-704499ea-6549-4e26-b2b8-e48e2b79a116 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:52.728477 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-704499ea-6549-4e26-b2b8-e48e2b79a116 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:52.862048 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-704499ea-6549-4e26-b2b8-e48e2b79a116 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:52.871200 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-704499ea-6549-4e26-b2b8-e48e2b79a116 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:52.872825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-704499ea-6549-4e26-b2b8-e48e2b79a116 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:52.874161 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-704499ea-6549-4e26-b2b8-e48e2b79a116 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1725 microversion: 2.20 time: 0.159388 Aug 31 01:24:52.874721 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 153/303] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:24:52 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:24:53.899476 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-08924c74-fe93-4638-8258-37260d689343 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:53.900257 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-08924c74-fe93-4638-8258-37260d689343 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:53.906541 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-08924c74-fe93-4638-8258-37260d689343 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:53.907119 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-08924c74-fe93-4638-8258-37260d689343 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:53.907559 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-08924c74-fe93-4638-8258-37260d689343 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:53.908253 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-08924c74-fe93-4638-8258-37260d689343 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:53.908706 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-08924c74-fe93-4638-8258-37260d689343 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:53.909155 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-08924c74-fe93-4638-8258-37260d689343 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:54.040682 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-08924c74-fe93-4638-8258-37260d689343 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:54.048675 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-08924c74-fe93-4638-8258-37260d689343 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:54.050366 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-08924c74-fe93-4638-8258-37260d689343 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:54.052022 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-08924c74-fe93-4638-8258-37260d689343 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1725 microversion: 2.20 time: 0.157375 Aug 31 01:24:54.052580 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 151/304] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:24:53 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:24:55.075031 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-62d84431-d0a5-4023-b883-638d768572d8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:55.075644 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-62d84431-d0a5-4023-b883-638d768572d8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:55.083205 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-62d84431-d0a5-4023-b883-638d768572d8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:55.083689 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-62d84431-d0a5-4023-b883-638d768572d8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:55.084124 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-62d84431-d0a5-4023-b883-638d768572d8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:55.084875 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-62d84431-d0a5-4023-b883-638d768572d8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:55.085332 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-62d84431-d0a5-4023-b883-638d768572d8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:55.085759 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-62d84431-d0a5-4023-b883-638d768572d8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:55.213071 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-62d84431-d0a5-4023-b883-638d768572d8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:55.221201 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-62d84431-d0a5-4023-b883-638d768572d8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:55.222646 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-62d84431-d0a5-4023-b883-638d768572d8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:55.223886 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-62d84431-d0a5-4023-b883-638d768572d8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1725 microversion: 2.20 time: 0.152952 Aug 31 01:24:55.224458 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 154/305] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:24:55 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:24:55.475525 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-292a4953-da0b-47d5-a791-b91df3d5803a tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-255239725", "imageRef": "ed6d3236-defa-4ccf-90ba-343c0d0ad58e", "flavorRef": "452"}} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:24:55.483372 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:24:55.530072 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.network.neutron [None req-292a4953-da0b-47d5-a791-b91df3d5803a tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] validate_networks() for None {{(pid=121025) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 01:24:55.798780 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-292a4953-da0b-47d5-a791-b91df3d5803a tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Flavor limits 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 01:24:55.799198 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-292a4953-da0b-47d5-a791-b91df3d5803a tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Image limits 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 01:24:55.799660 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-292a4953-da0b-47d5-a791-b91df3d5803a tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Flavor pref 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 01:24:55.800079 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-292a4953-da0b-47d5-a791-b91df3d5803a tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Image pref 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 01:24:55.800461 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-292a4953-da0b-47d5-a791-b91df3d5803a tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 01:24:55.809749 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-292a4953-da0b-47d5-a791-b91df3d5803a tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:55.810215 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-292a4953-da0b-47d5-a791-b91df3d5803a tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:55.810638 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-292a4953-da0b-47d5-a791-b91df3d5803a tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:55.811350 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-292a4953-da0b-47d5-a791-b91df3d5803a tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:55.811794 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-292a4953-da0b-47d5-a791-b91df3d5803a tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:55.812207 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-292a4953-da0b-47d5-a791-b91df3d5803a tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:55.828296 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.quota [None req-292a4953-da0b-47d5-a791-b91df3d5803a tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Getting quotas for project 6ac413264abe44918f2d1c65a365c063. Resources: {'instances', 'cores', 'ram'} {{(pid=121025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 01:24:55.832707 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.quota [None req-292a4953-da0b-47d5-a791-b91df3d5803a tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Getting quotas for user c87f30ec33384ef483ee7bca27d4bb54 and project 6ac413264abe44918f2d1c65a365c063. Resources: {'instances', 'cores', 'ram'} {{(pid=121025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 01:24:55.843592 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-292a4953-da0b-47d5-a791-b91df3d5803a tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Going to run 1 instances... {{(pid=121025) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 01:24:55.845983 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-292a4953-da0b-47d5-a791-b91df3d5803a tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] [instance: 0652e608-c1c4-41e6-949e-6c5a486e2979] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ed6d3236-defa-4ccf-90ba-343c0d0ad58e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 01:24:55.991178 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-292a4953-da0b-47d5-a791-b91df3d5803a tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.519426 Aug 31 01:24:55.991847 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 152/306] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 31 01:24:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 01:24:56.002593 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-d3c5cea5-b852-445b-bad3-9ac3aa859b91 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:56.003141 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-d3c5cea5-b852-445b-bad3-9ac3aa859b91 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] [instance: 0652e608-c1c4-41e6-949e-6c5a486e2979] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:56.055450 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-d3c5cea5-b852-445b-bad3-9ac3aa859b91 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f30ec33384ef483ee7bca27d4bb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac413264abe44918f2d1c65a365c063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:56.062489 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-d3c5cea5-b852-445b-bad3-9ac3aa859b91 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] 10.222.0.20 "GET /compute/v2.1/servers/0652e608-c1c4-41e6-949e-6c5a486e2979" status: 200 len: 1214 microversion: 2.1 time: 0.063863 Aug 31 01:24:56.063446 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 155/307] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:55 2022] GET /compute/v2.1/servers/0652e608-c1c4-41e6-949e-6c5a486e2979 => generated 1214 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:56.247301 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-a7798a3b-5f12-4c36-b9d1-09732aa5541a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:56.247922 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-a7798a3b-5f12-4c36-b9d1-09732aa5541a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:56.254709 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a7798a3b-5f12-4c36-b9d1-09732aa5541a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:56.255143 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a7798a3b-5f12-4c36-b9d1-09732aa5541a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:56.255577 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a7798a3b-5f12-4c36-b9d1-09732aa5541a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:56.256262 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a7798a3b-5f12-4c36-b9d1-09732aa5541a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:56.256716 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a7798a3b-5f12-4c36-b9d1-09732aa5541a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:56.257160 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a7798a3b-5f12-4c36-b9d1-09732aa5541a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:56.387725 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-a7798a3b-5f12-4c36-b9d1-09732aa5541a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:56.396491 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-a7798a3b-5f12-4c36-b9d1-09732aa5541a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:56.398095 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-a7798a3b-5f12-4c36-b9d1-09732aa5541a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:56.399243 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-a7798a3b-5f12-4c36-b9d1-09732aa5541a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1725 microversion: 2.20 time: 0.155933 Aug 31 01:24:56.399805 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 153/308] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:24:56 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:24:57.083488 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-367d5aa8-0efd-40ac-8a78-fe1b596d8a60 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:57.084120 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-367d5aa8-0efd-40ac-8a78-fe1b596d8a60 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] [instance: 0652e608-c1c4-41e6-949e-6c5a486e2979] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:57.090436 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-367d5aa8-0efd-40ac-8a78-fe1b596d8a60 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:57.090918 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-367d5aa8-0efd-40ac-8a78-fe1b596d8a60 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:57.091353 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-367d5aa8-0efd-40ac-8a78-fe1b596d8a60 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:57.092037 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-367d5aa8-0efd-40ac-8a78-fe1b596d8a60 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:57.092490 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-367d5aa8-0efd-40ac-8a78-fe1b596d8a60 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:57.092948 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-367d5aa8-0efd-40ac-8a78-fe1b596d8a60 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:57.153421 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-367d5aa8-0efd-40ac-8a78-fe1b596d8a60 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f30ec33384ef483ee7bca27d4bb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac413264abe44918f2d1c65a365c063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:57.161153 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-367d5aa8-0efd-40ac-8a78-fe1b596d8a60 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] 10.222.0.20 "GET /compute/v2.1/servers/0652e608-c1c4-41e6-949e-6c5a486e2979" status: 200 len: 1218 microversion: 2.1 time: 0.081617 Aug 31 01:24:57.161717 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 156/309] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:57 2022] GET /compute/v2.1/servers/0652e608-c1c4-41e6-949e-6c5a486e2979 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:57.422399 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-0478cf38-bdbb-43b5-b59b-6ab7ed335e76 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:57.423001 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-0478cf38-bdbb-43b5-b59b-6ab7ed335e76 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:57.430036 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0478cf38-bdbb-43b5-b59b-6ab7ed335e76 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:57.430513 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0478cf38-bdbb-43b5-b59b-6ab7ed335e76 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:57.431424 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0478cf38-bdbb-43b5-b59b-6ab7ed335e76 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:57.432396 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0478cf38-bdbb-43b5-b59b-6ab7ed335e76 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:57.433071 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0478cf38-bdbb-43b5-b59b-6ab7ed335e76 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:57.433498 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0478cf38-bdbb-43b5-b59b-6ab7ed335e76 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:57.564227 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-0478cf38-bdbb-43b5-b59b-6ab7ed335e76 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:57.572387 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-0478cf38-bdbb-43b5-b59b-6ab7ed335e76 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:57.573830 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-0478cf38-bdbb-43b5-b59b-6ab7ed335e76 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:57.574997 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-0478cf38-bdbb-43b5-b59b-6ab7ed335e76 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1746 microversion: 2.20 time: 0.156972 Aug 31 01:24:57.575670 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 154/310] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:24:57 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:24:58.181304 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-47694a6b-e0b6-44a7-a71a-a8c0687a1a21 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:58.182061 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-47694a6b-e0b6-44a7-a71a-a8c0687a1a21 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] [instance: 0652e608-c1c4-41e6-949e-6c5a486e2979] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:58.188963 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-47694a6b-e0b6-44a7-a71a-a8c0687a1a21 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:58.189439 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-47694a6b-e0b6-44a7-a71a-a8c0687a1a21 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:58.189861 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-47694a6b-e0b6-44a7-a71a-a8c0687a1a21 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:58.190543 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-47694a6b-e0b6-44a7-a71a-a8c0687a1a21 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:58.190988 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-47694a6b-e0b6-44a7-a71a-a8c0687a1a21 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:58.191519 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-47694a6b-e0b6-44a7-a71a-a8c0687a1a21 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:58.259524 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-47694a6b-e0b6-44a7-a71a-a8c0687a1a21 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f30ec33384ef483ee7bca27d4bb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac413264abe44918f2d1c65a365c063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:58.267264 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-47694a6b-e0b6-44a7-a71a-a8c0687a1a21 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] 10.222.0.20 "GET /compute/v2.1/servers/0652e608-c1c4-41e6-949e-6c5a486e2979" status: 200 len: 1266 microversion: 2.1 time: 0.090001 Aug 31 01:24:58.267814 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 157/311] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:58 2022] GET /compute/v2.1/servers/0652e608-c1c4-41e6-949e-6c5a486e2979 => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:24:58.598740 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-6e520c96-0df7-4acf-8510-d933ecb3b523 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:58.599348 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-6e520c96-0df7-4acf-8510-d933ecb3b523 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:58.605843 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6e520c96-0df7-4acf-8510-d933ecb3b523 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:58.606328 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6e520c96-0df7-4acf-8510-d933ecb3b523 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:58.606764 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6e520c96-0df7-4acf-8510-d933ecb3b523 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:58.607458 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6e520c96-0df7-4acf-8510-d933ecb3b523 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:58.607920 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6e520c96-0df7-4acf-8510-d933ecb3b523 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:58.608390 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6e520c96-0df7-4acf-8510-d933ecb3b523 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:58.742941 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-6e520c96-0df7-4acf-8510-d933ecb3b523 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:58.751147 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-6e520c96-0df7-4acf-8510-d933ecb3b523 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:58.752681 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-6e520c96-0df7-4acf-8510-d933ecb3b523 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:58.753841 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-6e520c96-0df7-4acf-8510-d933ecb3b523 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1746 microversion: 2.20 time: 0.159133 Aug 31 01:24:58.754416 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 155/312] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:24:58 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:24:59.289271 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-e1f67547-0f4d-4d68-8e4c-8678f0b7f106 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:59.290483 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-e1f67547-0f4d-4d68-8e4c-8678f0b7f106 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] [instance: 0652e608-c1c4-41e6-949e-6c5a486e2979] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:59.296539 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_api:SELECT=72 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:24:59.300530 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e1f67547-0f4d-4d68-8e4c-8678f0b7f106 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:59.300530 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e1f67547-0f4d-4d68-8e4c-8678f0b7f106 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:59.300530 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e1f67547-0f4d-4d68-8e4c-8678f0b7f106 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:59.300530 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e1f67547-0f4d-4d68-8e4c-8678f0b7f106 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:59.301017 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e1f67547-0f4d-4d68-8e4c-8678f0b7f106 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:59.301617 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e1f67547-0f4d-4d68-8e4c-8678f0b7f106 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:59.379406 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-e1f67547-0f4d-4d68-8e4c-8678f0b7f106 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f30ec33384ef483ee7bca27d4bb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac413264abe44918f2d1c65a365c063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:24:59.387698 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-e1f67547-0f4d-4d68-8e4c-8678f0b7f106 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] 10.222.0.20 "GET /compute/v2.1/servers/0652e608-c1c4-41e6-949e-6c5a486e2979" status: 200 len: 1272 microversion: 2.1 time: 0.103231 Aug 31 01:24:59.388265 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 158/313] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:24:59 2022] GET /compute/v2.1/servers/0652e608-c1c4-41e6-949e-6c5a486e2979 => generated 1272 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:24:59.777715 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-cdafb47f-56b9-4d11-b365-55e371ca9f3a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:24:59.778538 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-cdafb47f-56b9-4d11-b365-55e371ca9f3a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:24:59.787844 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cdafb47f-56b9-4d11-b365-55e371ca9f3a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:59.790479 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cdafb47f-56b9-4d11-b365-55e371ca9f3a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:59.793806 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cdafb47f-56b9-4d11-b365-55e371ca9f3a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:24:59.794868 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cdafb47f-56b9-4d11-b365-55e371ca9f3a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:24:59.796183 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cdafb47f-56b9-4d11-b365-55e371ca9f3a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:24:59.797633 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cdafb47f-56b9-4d11-b365-55e371ca9f3a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:00.000015 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-cdafb47f-56b9-4d11-b365-55e371ca9f3a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:00.010038 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-cdafb47f-56b9-4d11-b365-55e371ca9f3a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:00.011508 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-cdafb47f-56b9-4d11-b365-55e371ca9f3a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:00.012918 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-cdafb47f-56b9-4d11-b365-55e371ca9f3a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1741 microversion: 2.20 time: 0.239460 Aug 31 01:25:00.024749 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 156/314] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:24:59 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1741 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:25:00.408819 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-37a4babe-9c67-4b1c-8d23-8986fd608fb0 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:00.410017 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-37a4babe-9c67-4b1c-8d23-8986fd608fb0 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] [instance: 0652e608-c1c4-41e6-949e-6c5a486e2979] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:00.423633 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-37a4babe-9c67-4b1c-8d23-8986fd608fb0 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:00.424509 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-37a4babe-9c67-4b1c-8d23-8986fd608fb0 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:00.424979 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-37a4babe-9c67-4b1c-8d23-8986fd608fb0 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:00.428603 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-37a4babe-9c67-4b1c-8d23-8986fd608fb0 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:00.429107 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-37a4babe-9c67-4b1c-8d23-8986fd608fb0 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:00.429537 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-37a4babe-9c67-4b1c-8d23-8986fd608fb0 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:00.887477 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-53488e6a-e545-41a1-bfed-b0cdf87ffc43 req-bbb40647-4a79-40ca-8a35-d956a2b11235 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12814f73-696a-4dc2-9182-7779bfe90ad5", "name": "network-vif-plugged", "status": "completed", "tag": "dc60a507-f9d6-4b68-ae6c-65c2cfafb12c"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:25:00.908347 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-53488e6a-e545-41a1-bfed-b0cdf87ffc43 req-bbb40647-4a79-40ca-8a35-d956a2b11235 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:00.909036 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-53488e6a-e545-41a1-bfed-b0cdf87ffc43 req-bbb40647-4a79-40ca-8a35-d956a2b11235 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:00.909636 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-53488e6a-e545-41a1-bfed-b0cdf87ffc43 req-bbb40647-4a79-40ca-8a35-d956a2b11235 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:00.924684 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-53488e6a-e545-41a1-bfed-b0cdf87ffc43 req-bbb40647-4a79-40ca-8a35-d956a2b11235 service nova] Creating event network-vif-plugged:dc60a507-f9d6-4b68-ae6c-65c2cfafb12c for instance 12814f73-696a-4dc2-9182-7779bfe90ad5 on hv-cinder-85528 Aug 31 01:25:00.944781 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-53488e6a-e545-41a1-bfed-b0cdf87ffc43 req-bbb40647-4a79-40ca-8a35-d956a2b11235 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060300 Aug 31 01:25:00.946228 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 157/315] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:25:01.017635 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-37a4babe-9c67-4b1c-8d23-8986fd608fb0 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f30ec33384ef483ee7bca27d4bb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac413264abe44918f2d1c65a365c063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:01.026225 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-37a4babe-9c67-4b1c-8d23-8986fd608fb0 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] 10.222.0.20 "GET /compute/v2.1/servers/0652e608-c1c4-41e6-949e-6c5a486e2979" status: 200 len: 1314 microversion: 2.1 time: 0.621428 Aug 31 01:25:01.043194 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-5ed27f51-4e83-4b4f-8232-feadd05ebe02 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:01.054789 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-5ed27f51-4e83-4b4f-8232-feadd05ebe02 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:01.055025 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 159/316] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:00 2022] GET /compute/v2.1/servers/0652e608-c1c4-41e6-949e-6c5a486e2979 => generated 1314 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:25:01.081947 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5ed27f51-4e83-4b4f-8232-feadd05ebe02 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:01.082813 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5ed27f51-4e83-4b4f-8232-feadd05ebe02 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:01.083477 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5ed27f51-4e83-4b4f-8232-feadd05ebe02 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:01.085508 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5ed27f51-4e83-4b4f-8232-feadd05ebe02 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:01.087045 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5ed27f51-4e83-4b4f-8232-feadd05ebe02 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:01.087543 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5ed27f51-4e83-4b4f-8232-feadd05ebe02 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:01.406189 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-5ed27f51-4e83-4b4f-8232-feadd05ebe02 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:01.420241 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-5ed27f51-4e83-4b4f-8232-feadd05ebe02 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:01.421705 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-5ed27f51-4e83-4b4f-8232-feadd05ebe02 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:01.424444 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-5ed27f51-4e83-4b4f-8232-feadd05ebe02 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1741 microversion: 2.20 time: 0.390717 Aug 31 01:25:01.439224 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 158/317] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:01 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1741 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:25:01.708005 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [req-2817cf7b-9ad8-48a5-9d5c-a8cc493b5de0 req-34fcd8a1-2623-43ef-b40d-f2a69f87d1da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0652e608-c1c4-41e6-949e-6c5a486e2979", "tag": "01016668-5bcb-48c2-a9e3-5491867dfd41"}]} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:25:01.726746 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-2817cf7b-9ad8-48a5-9d5c-a8cc493b5de0 req-34fcd8a1-2623-43ef-b40d-f2a69f87d1da service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:01.727582 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-2817cf7b-9ad8-48a5-9d5c-a8cc493b5de0 req-34fcd8a1-2623-43ef-b40d-f2a69f87d1da service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:01.728388 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-2817cf7b-9ad8-48a5-9d5c-a8cc493b5de0 req-34fcd8a1-2623-43ef-b40d-f2a69f87d1da service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:01.745141 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.compute.server_external_events [req-2817cf7b-9ad8-48a5-9d5c-a8cc493b5de0 req-34fcd8a1-2623-43ef-b40d-f2a69f87d1da service nova] Creating event network-changed:01016668-5bcb-48c2-a9e3-5491867dfd41 for instance 0652e608-c1c4-41e6-949e-6c5a486e2979 on hv-cinder-85528 Aug 31 01:25:01.750611 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [req-2817cf7b-9ad8-48a5-9d5c-a8cc493b5de0 req-34fcd8a1-2623-43ef-b40d-f2a69f87d1da service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047460 Aug 31 01:25:01.752076 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 160/318] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:25:02.057732 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-0dbe82c9-0a70-448c-a45c-9a622c372c81 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:02.059046 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-0dbe82c9-0a70-448c-a45c-9a622c372c81 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] [instance: 0652e608-c1c4-41e6-949e-6c5a486e2979] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:02.065547 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0dbe82c9-0a70-448c-a45c-9a622c372c81 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:02.066355 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0dbe82c9-0a70-448c-a45c-9a622c372c81 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:02.067869 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0dbe82c9-0a70-448c-a45c-9a622c372c81 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:02.068901 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0dbe82c9-0a70-448c-a45c-9a622c372c81 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:02.069840 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0dbe82c9-0a70-448c-a45c-9a622c372c81 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:02.070473 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0dbe82c9-0a70-448c-a45c-9a622c372c81 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:02.093835 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell1:SELECT=100 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:25:02.336794 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-0dbe82c9-0a70-448c-a45c-9a622c372c81 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f30ec33384ef483ee7bca27d4bb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac413264abe44918f2d1c65a365c063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:02.353286 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-0dbe82c9-0a70-448c-a45c-9a622c372c81 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] 10.222.0.20 "GET /compute/v2.1/servers/0652e608-c1c4-41e6-949e-6c5a486e2979" status: 200 len: 1314 microversion: 2.1 time: 0.299193 Aug 31 01:25:02.369835 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 159/319] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:02 2022] GET /compute/v2.1/servers/0652e608-c1c4-41e6-949e-6c5a486e2979 => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:25:02.449494 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-cc475104-8458-4c81-87da-be69cbcf89ec tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:02.450487 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-cc475104-8458-4c81-87da-be69cbcf89ec tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:02.458248 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cc475104-8458-4c81-87da-be69cbcf89ec tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:02.459321 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cc475104-8458-4c81-87da-be69cbcf89ec tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:02.460034 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cc475104-8458-4c81-87da-be69cbcf89ec tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:02.460688 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cc475104-8458-4c81-87da-be69cbcf89ec tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:02.461270 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cc475104-8458-4c81-87da-be69cbcf89ec tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:02.461849 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cc475104-8458-4c81-87da-be69cbcf89ec tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:02.728152 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-cc475104-8458-4c81-87da-be69cbcf89ec tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:02.743660 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-cc475104-8458-4c81-87da-be69cbcf89ec tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:02.746891 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-cc475104-8458-4c81-87da-be69cbcf89ec tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:02.746891 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-cc475104-8458-4c81-87da-be69cbcf89ec tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1741 microversion: 2.20 time: 0.301867 Aug 31 01:25:02.747255 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 161/320] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:02 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1741 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:25:03.376138 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-2604b547-68b1-4496-b460-89ef5936d081 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:03.376698 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-2604b547-68b1-4496-b460-89ef5936d081 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] [instance: 0652e608-c1c4-41e6-949e-6c5a486e2979] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:03.383634 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2604b547-68b1-4496-b460-89ef5936d081 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:03.384110 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2604b547-68b1-4496-b460-89ef5936d081 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:03.384535 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2604b547-68b1-4496-b460-89ef5936d081 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:03.385265 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2604b547-68b1-4496-b460-89ef5936d081 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:03.385830 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2604b547-68b1-4496-b460-89ef5936d081 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:03.386251 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2604b547-68b1-4496-b460-89ef5936d081 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:03.528858 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-2604b547-68b1-4496-b460-89ef5936d081 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f30ec33384ef483ee7bca27d4bb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac413264abe44918f2d1c65a365c063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:03.541247 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-2604b547-68b1-4496-b460-89ef5936d081 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] 10.222.0.20 "GET /compute/v2.1/servers/0652e608-c1c4-41e6-949e-6c5a486e2979" status: 200 len: 1314 microversion: 2.1 time: 0.168599 Aug 31 01:25:03.541737 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 160/321] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:03 2022] GET /compute/v2.1/servers/0652e608-c1c4-41e6-949e-6c5a486e2979 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:25:03.771467 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-33f96a87-1526-4a48-8231-01671d8fd074 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:03.772075 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-33f96a87-1526-4a48-8231-01671d8fd074 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:03.779052 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-33f96a87-1526-4a48-8231-01671d8fd074 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:03.779620 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-33f96a87-1526-4a48-8231-01671d8fd074 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:03.779961 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-33f96a87-1526-4a48-8231-01671d8fd074 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:03.780653 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-33f96a87-1526-4a48-8231-01671d8fd074 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:03.781130 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-33f96a87-1526-4a48-8231-01671d8fd074 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:03.781735 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-33f96a87-1526-4a48-8231-01671d8fd074 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:03.956297 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-33f96a87-1526-4a48-8231-01671d8fd074 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:03.968818 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-33f96a87-1526-4a48-8231-01671d8fd074 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:03.970584 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-33f96a87-1526-4a48-8231-01671d8fd074 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:03.972020 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-33f96a87-1526-4a48-8231-01671d8fd074 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1741 microversion: 2.20 time: 0.204979 Aug 31 01:25:03.990550 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 162/322] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:03 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1741 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:25:04.563450 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-d36ba883-5ac5-4b3f-bdcf-19ebec5776e7 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:04.564173 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-d36ba883-5ac5-4b3f-bdcf-19ebec5776e7 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] [instance: 0652e608-c1c4-41e6-949e-6c5a486e2979] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:04.571176 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d36ba883-5ac5-4b3f-bdcf-19ebec5776e7 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:04.571663 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d36ba883-5ac5-4b3f-bdcf-19ebec5776e7 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:04.572095 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d36ba883-5ac5-4b3f-bdcf-19ebec5776e7 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:04.572817 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d36ba883-5ac5-4b3f-bdcf-19ebec5776e7 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:04.573276 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d36ba883-5ac5-4b3f-bdcf-19ebec5776e7 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:04.573698 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d36ba883-5ac5-4b3f-bdcf-19ebec5776e7 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:04.769670 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-d36ba883-5ac5-4b3f-bdcf-19ebec5776e7 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f30ec33384ef483ee7bca27d4bb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac413264abe44918f2d1c65a365c063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:04.787252 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-d36ba883-5ac5-4b3f-bdcf-19ebec5776e7 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] 10.222.0.20 "GET /compute/v2.1/servers/0652e608-c1c4-41e6-949e-6c5a486e2979" status: 200 len: 1314 microversion: 2.1 time: 0.228039 Aug 31 01:25:04.787827 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 161/323] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:04 2022] GET /compute/v2.1/servers/0652e608-c1c4-41e6-949e-6c5a486e2979 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:25:04.995950 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-c6c87d61-8fd0-40c2-a4ae-f3bfa6e50123 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:05.001592 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-c6c87d61-8fd0-40c2-a4ae-f3bfa6e50123 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:05.004219 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c6c87d61-8fd0-40c2-a4ae-f3bfa6e50123 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:05.004924 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c6c87d61-8fd0-40c2-a4ae-f3bfa6e50123 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:05.005360 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c6c87d61-8fd0-40c2-a4ae-f3bfa6e50123 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:05.006235 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c6c87d61-8fd0-40c2-a4ae-f3bfa6e50123 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:05.006843 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c6c87d61-8fd0-40c2-a4ae-f3bfa6e50123 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:05.007433 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c6c87d61-8fd0-40c2-a4ae-f3bfa6e50123 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:05.153143 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-c6c87d61-8fd0-40c2-a4ae-f3bfa6e50123 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:05.173956 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-c6c87d61-8fd0-40c2-a4ae-f3bfa6e50123 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:05.173956 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-c6c87d61-8fd0-40c2-a4ae-f3bfa6e50123 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:05.173956 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-c6c87d61-8fd0-40c2-a4ae-f3bfa6e50123 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1741 microversion: 2.20 time: 0.173402 Aug 31 01:25:05.174382 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 163/324] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:04 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1741 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:25:05.825033 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-af4b15da-0c72-46f5-b11c-815a5b4ea6eb tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:05.825033 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-af4b15da-0c72-46f5-b11c-815a5b4ea6eb tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] [instance: 0652e608-c1c4-41e6-949e-6c5a486e2979] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:05.825033 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell0:SELECT=2 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:25:05.825033 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-af4b15da-0c72-46f5-b11c-815a5b4ea6eb tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:05.825033 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-af4b15da-0c72-46f5-b11c-815a5b4ea6eb tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:05.825826 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-af4b15da-0c72-46f5-b11c-815a5b4ea6eb tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:05.825826 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-af4b15da-0c72-46f5-b11c-815a5b4ea6eb tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:05.825826 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-af4b15da-0c72-46f5-b11c-815a5b4ea6eb tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:05.825826 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-af4b15da-0c72-46f5-b11c-815a5b4ea6eb tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:05.845116 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell0:SELECT=6 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:25:06.009509 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-af4b15da-0c72-46f5-b11c-815a5b4ea6eb tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f30ec33384ef483ee7bca27d4bb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac413264abe44918f2d1c65a365c063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:06.017270 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-af4b15da-0c72-46f5-b11c-815a5b4ea6eb tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] 10.222.0.20 "GET /compute/v2.1/servers/0652e608-c1c4-41e6-949e-6c5a486e2979" status: 200 len: 1314 microversion: 2.1 time: 0.213341 Aug 31 01:25:06.018297 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 162/325] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:05 2022] GET /compute/v2.1/servers/0652e608-c1c4-41e6-949e-6c5a486e2979 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:25:06.189423 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-761d380b-5c77-4b30-8207-29c575d8c627 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:06.190110 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-761d380b-5c77-4b30-8207-29c575d8c627 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:06.196809 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell0:SELECT=2 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:25:06.198966 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-761d380b-5c77-4b30-8207-29c575d8c627 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:06.199463 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-761d380b-5c77-4b30-8207-29c575d8c627 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:06.199900 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-761d380b-5c77-4b30-8207-29c575d8c627 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:06.200624 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-761d380b-5c77-4b30-8207-29c575d8c627 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:06.201118 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-761d380b-5c77-4b30-8207-29c575d8c627 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:06.201743 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-761d380b-5c77-4b30-8207-29c575d8c627 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:06.402347 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-761d380b-5c77-4b30-8207-29c575d8c627 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:06.412689 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-761d380b-5c77-4b30-8207-29c575d8c627 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:06.414402 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-761d380b-5c77-4b30-8207-29c575d8c627 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:06.415566 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-761d380b-5c77-4b30-8207-29c575d8c627 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1741 microversion: 2.20 time: 0.230154 Aug 31 01:25:06.416129 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 164/326] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:06 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1741 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:25:07.027017 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-12595640-2a89-4bfe-9fd6-b41c2b1e2609 req-e81f3d50-c179-48b6-ab4a-7cd91f4e580d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0652e608-c1c4-41e6-949e-6c5a486e2979", "name": "network-vif-plugged", "status": "completed", "tag": "01016668-5bcb-48c2-a9e3-5491867dfd41"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:25:07.042459 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-e3d116de-dedc-4c58-9027-ed250849c7d2 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:07.043416 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-e3d116de-dedc-4c58-9027-ed250849c7d2 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] [instance: 0652e608-c1c4-41e6-949e-6c5a486e2979] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:07.049963 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e3d116de-dedc-4c58-9027-ed250849c7d2 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:07.050599 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-12595640-2a89-4bfe-9fd6-b41c2b1e2609 req-e81f3d50-c179-48b6-ab4a-7cd91f4e580d service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:07.051432 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e3d116de-dedc-4c58-9027-ed250849c7d2 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:07.051565 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-12595640-2a89-4bfe-9fd6-b41c2b1e2609 req-e81f3d50-c179-48b6-ab4a-7cd91f4e580d service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:07.051995 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-12595640-2a89-4bfe-9fd6-b41c2b1e2609 req-e81f3d50-c179-48b6-ab4a-7cd91f4e580d service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:07.052143 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e3d116de-dedc-4c58-9027-ed250849c7d2 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:07.052995 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e3d116de-dedc-4c58-9027-ed250849c7d2 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:07.053632 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e3d116de-dedc-4c58-9027-ed250849c7d2 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:07.054209 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e3d116de-dedc-4c58-9027-ed250849c7d2 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:07.086594 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-12595640-2a89-4bfe-9fd6-b41c2b1e2609 req-e81f3d50-c179-48b6-ab4a-7cd91f4e580d service nova] Creating event network-vif-plugged:01016668-5bcb-48c2-a9e3-5491867dfd41 for instance 0652e608-c1c4-41e6-949e-6c5a486e2979 on hv-cinder-85528 Aug 31 01:25:07.096747 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-12595640-2a89-4bfe-9fd6-b41c2b1e2609 req-e81f3d50-c179-48b6-ab4a-7cd91f4e580d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074154 Aug 31 01:25:07.098777 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 163/327] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:25:07.211140 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-e3d116de-dedc-4c58-9027-ed250849c7d2 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f30ec33384ef483ee7bca27d4bb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac413264abe44918f2d1c65a365c063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:07.233721 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-e3d116de-dedc-4c58-9027-ed250849c7d2 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] 10.222.0.20 "GET /compute/v2.1/servers/0652e608-c1c4-41e6-949e-6c5a486e2979" status: 200 len: 1314 microversion: 2.1 time: 0.181754 Aug 31 01:25:07.253042 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 165/328] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:07 2022] GET /compute/v2.1/servers/0652e608-c1c4-41e6-949e-6c5a486e2979 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:25:07.443860 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-a6b45ded-cdbc-4987-829a-1cf9de8982e4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:07.444566 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-a6b45ded-cdbc-4987-829a-1cf9de8982e4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:07.451835 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a6b45ded-cdbc-4987-829a-1cf9de8982e4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:07.452318 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a6b45ded-cdbc-4987-829a-1cf9de8982e4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:07.452970 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a6b45ded-cdbc-4987-829a-1cf9de8982e4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:07.454137 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a6b45ded-cdbc-4987-829a-1cf9de8982e4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:07.454624 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a6b45ded-cdbc-4987-829a-1cf9de8982e4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:07.455199 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a6b45ded-cdbc-4987-829a-1cf9de8982e4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:07.660139 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-a6b45ded-cdbc-4987-829a-1cf9de8982e4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:07.669934 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-a6b45ded-cdbc-4987-829a-1cf9de8982e4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:07.671715 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-a6b45ded-cdbc-4987-829a-1cf9de8982e4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:07.672976 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-a6b45ded-cdbc-4987-829a-1cf9de8982e4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1741 microversion: 2.20 time: 0.237096 Aug 31 01:25:07.689217 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 164/329] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:07 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1741 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:25:08.258559 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-5e509754-34bb-4863-a76e-5016e3777317 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:08.259168 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-5e509754-34bb-4863-a76e-5016e3777317 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] [instance: 0652e608-c1c4-41e6-949e-6c5a486e2979] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:08.267103 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5e509754-34bb-4863-a76e-5016e3777317 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:08.267596 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5e509754-34bb-4863-a76e-5016e3777317 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:08.268074 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5e509754-34bb-4863-a76e-5016e3777317 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:08.268885 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5e509754-34bb-4863-a76e-5016e3777317 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:08.269547 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5e509754-34bb-4863-a76e-5016e3777317 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:08.270195 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5e509754-34bb-4863-a76e-5016e3777317 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:08.469836 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-5e509754-34bb-4863-a76e-5016e3777317 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f30ec33384ef483ee7bca27d4bb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac413264abe44918f2d1c65a365c063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:08.479941 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-5e509754-34bb-4863-a76e-5016e3777317 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] 10.222.0.20 "GET /compute/v2.1/servers/0652e608-c1c4-41e6-949e-6c5a486e2979" status: 200 len: 1314 microversion: 2.1 time: 0.225770 Aug 31 01:25:08.481206 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 166/330] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:08 2022] GET /compute/v2.1/servers/0652e608-c1c4-41e6-949e-6c5a486e2979 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:25:08.698542 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-f12a7c2a-6875-47fa-b0e8-35646fa79c3b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:08.699940 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-f12a7c2a-6875-47fa-b0e8-35646fa79c3b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:08.707907 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f12a7c2a-6875-47fa-b0e8-35646fa79c3b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:08.708507 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f12a7c2a-6875-47fa-b0e8-35646fa79c3b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:08.709024 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f12a7c2a-6875-47fa-b0e8-35646fa79c3b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:08.710073 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f12a7c2a-6875-47fa-b0e8-35646fa79c3b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:08.710608 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f12a7c2a-6875-47fa-b0e8-35646fa79c3b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:08.711173 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f12a7c2a-6875-47fa-b0e8-35646fa79c3b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:08.880313 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-f12a7c2a-6875-47fa-b0e8-35646fa79c3b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:08.889582 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-f12a7c2a-6875-47fa-b0e8-35646fa79c3b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:08.893851 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-f12a7c2a-6875-47fa-b0e8-35646fa79c3b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:08.895922 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-f12a7c2a-6875-47fa-b0e8-35646fa79c3b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1741 microversion: 2.20 time: 0.202231 Aug 31 01:25:08.897618 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 165/331] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:08 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1741 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:25:09.501866 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-cb90adb9-2868-496a-98bb-974bf1385cb8 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:09.503486 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-cb90adb9-2868-496a-98bb-974bf1385cb8 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] [instance: 0652e608-c1c4-41e6-949e-6c5a486e2979] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:09.511887 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cb90adb9-2868-496a-98bb-974bf1385cb8 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:09.512367 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cb90adb9-2868-496a-98bb-974bf1385cb8 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:09.512824 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cb90adb9-2868-496a-98bb-974bf1385cb8 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:09.513534 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cb90adb9-2868-496a-98bb-974bf1385cb8 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:09.513980 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cb90adb9-2868-496a-98bb-974bf1385cb8 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:09.514426 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cb90adb9-2868-496a-98bb-974bf1385cb8 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:09.534691 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell1:SELECT=100 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:25:09.659330 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-cb90adb9-2868-496a-98bb-974bf1385cb8 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f30ec33384ef483ee7bca27d4bb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac413264abe44918f2d1c65a365c063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:09.667761 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-cb90adb9-2868-496a-98bb-974bf1385cb8 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] 10.222.0.20 "GET /compute/v2.1/servers/0652e608-c1c4-41e6-949e-6c5a486e2979" status: 200 len: 1314 microversion: 2.1 time: 0.169755 Aug 31 01:25:09.668066 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 167/332] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:09 2022] GET /compute/v2.1/servers/0652e608-c1c4-41e6-949e-6c5a486e2979 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:25:09.920700 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-0a22f0ef-6fca-42d2-8a4a-71a9df3b76d2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:09.921444 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-0a22f0ef-6fca-42d2-8a4a-71a9df3b76d2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:09.930292 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0a22f0ef-6fca-42d2-8a4a-71a9df3b76d2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:09.930812 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0a22f0ef-6fca-42d2-8a4a-71a9df3b76d2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:09.931245 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0a22f0ef-6fca-42d2-8a4a-71a9df3b76d2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:09.931936 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0a22f0ef-6fca-42d2-8a4a-71a9df3b76d2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:09.932419 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0a22f0ef-6fca-42d2-8a4a-71a9df3b76d2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:09.932933 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0a22f0ef-6fca-42d2-8a4a-71a9df3b76d2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:10.064571 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-0a22f0ef-6fca-42d2-8a4a-71a9df3b76d2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:10.072597 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-0a22f0ef-6fca-42d2-8a4a-71a9df3b76d2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:10.074032 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-0a22f0ef-6fca-42d2-8a4a-71a9df3b76d2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:10.075177 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-0a22f0ef-6fca-42d2-8a4a-71a9df3b76d2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1741 microversion: 2.20 time: 0.159612 Aug 31 01:25:10.075893 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 166/333] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:09 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1741 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:25:10.689334 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-002cae61-a015-49aa-8e63-4d27ea6907c8 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:10.690558 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-002cae61-a015-49aa-8e63-4d27ea6907c8 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] [instance: 0652e608-c1c4-41e6-949e-6c5a486e2979] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:10.702952 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-002cae61-a015-49aa-8e63-4d27ea6907c8 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:10.703824 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-002cae61-a015-49aa-8e63-4d27ea6907c8 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:10.705026 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-002cae61-a015-49aa-8e63-4d27ea6907c8 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:10.705181 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-002cae61-a015-49aa-8e63-4d27ea6907c8 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:10.705550 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-002cae61-a015-49aa-8e63-4d27ea6907c8 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:10.705962 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-002cae61-a015-49aa-8e63-4d27ea6907c8 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:10.848577 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-002cae61-a015-49aa-8e63-4d27ea6907c8 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f30ec33384ef483ee7bca27d4bb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac413264abe44918f2d1c65a365c063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:10.857284 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-002cae61-a015-49aa-8e63-4d27ea6907c8 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] 10.222.0.20 "GET /compute/v2.1/servers/0652e608-c1c4-41e6-949e-6c5a486e2979" status: 200 len: 1463 microversion: 2.1 time: 0.171878 Aug 31 01:25:10.858065 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 168/334] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:10 2022] GET /compute/v2.1/servers/0652e608-c1c4-41e6-949e-6c5a486e2979 => generated 1463 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:25:10.907815 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-976376a6-a5c8-459e-bc70-f136a1b604f9 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:10.911726 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-976376a6-a5c8-459e-bc70-f136a1b604f9 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] [instance: 0652e608-c1c4-41e6-949e-6c5a486e2979] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:10.914597 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-976376a6-a5c8-459e-bc70-f136a1b604f9 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:10.915080 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-976376a6-a5c8-459e-bc70-f136a1b604f9 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:10.915501 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-976376a6-a5c8-459e-bc70-f136a1b604f9 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:10.916196 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-976376a6-a5c8-459e-bc70-f136a1b604f9 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:10.916642 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-976376a6-a5c8-459e-bc70-f136a1b604f9 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:10.917090 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-976376a6-a5c8-459e-bc70-f136a1b604f9 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:10.943705 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-976376a6-a5c8-459e-bc70-f136a1b604f9 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] [instance: 0652e608-c1c4-41e6-949e-6c5a486e2979] Going to try to terminate instance {{(pid=121025) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 01:25:11.098047 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-8d64b795-1401-481d-8452-0bc71e75256d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:11.098645 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-8d64b795-1401-481d-8452-0bc71e75256d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:11.104593 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8d64b795-1401-481d-8452-0bc71e75256d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:11.105114 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8d64b795-1401-481d-8452-0bc71e75256d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:11.105547 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8d64b795-1401-481d-8452-0bc71e75256d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:11.106226 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8d64b795-1401-481d-8452-0bc71e75256d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:11.106803 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8d64b795-1401-481d-8452-0bc71e75256d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:11.107224 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8d64b795-1401-481d-8452-0bc71e75256d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:11.239922 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-8d64b795-1401-481d-8452-0bc71e75256d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:11.248102 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-8d64b795-1401-481d-8452-0bc71e75256d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:11.249563 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-8d64b795-1401-481d-8452-0bc71e75256d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:11.250714 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-8d64b795-1401-481d-8452-0bc71e75256d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1741 microversion: 2.20 time: 0.156688 Aug 31 01:25:11.251268 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 169/335] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:11 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1741 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 01:25:11.372618 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-976376a6-a5c8-459e-bc70-f136a1b604f9 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0652e608-c1c4-41e6-949e-6c5a486e2979" status: 204 len: 0 microversion: 2.1 time: 0.468280 Aug 31 01:25:11.373254 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 167/336] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 01:25:10 2022] DELETE /compute/v2.1/servers/0652e608-c1c4-41e6-949e-6c5a486e2979 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 01:25:11.381832 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-72ef177a-7898-4751-87e2-9b5f80e6b8d3 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:11.382443 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-72ef177a-7898-4751-87e2-9b5f80e6b8d3 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] [instance: 0652e608-c1c4-41e6-949e-6c5a486e2979] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:11.388433 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-72ef177a-7898-4751-87e2-9b5f80e6b8d3 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:11.388973 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-72ef177a-7898-4751-87e2-9b5f80e6b8d3 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:11.389436 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-72ef177a-7898-4751-87e2-9b5f80e6b8d3 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:11.390126 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-72ef177a-7898-4751-87e2-9b5f80e6b8d3 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:11.390579 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-72ef177a-7898-4751-87e2-9b5f80e6b8d3 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:11.391000 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-72ef177a-7898-4751-87e2-9b5f80e6b8d3 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:11.540304 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-72ef177a-7898-4751-87e2-9b5f80e6b8d3 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f30ec33384ef483ee7bca27d4bb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac413264abe44918f2d1c65a365c063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:11.548457 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-72ef177a-7898-4751-87e2-9b5f80e6b8d3 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] 10.222.0.20 "GET /compute/v2.1/servers/0652e608-c1c4-41e6-949e-6c5a486e2979" status: 200 len: 1469 microversion: 2.1 time: 0.170985 Aug 31 01:25:11.557943 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 170/337] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:11 2022] GET /compute/v2.1/servers/0652e608-c1c4-41e6-949e-6c5a486e2979 => generated 1469 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:25:12.275356 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-efb32255-06ec-45cc-83c9-00b3f193252e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:12.276085 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-efb32255-06ec-45cc-83c9-00b3f193252e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:12.282568 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-efb32255-06ec-45cc-83c9-00b3f193252e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:12.283047 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-efb32255-06ec-45cc-83c9-00b3f193252e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:12.283479 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-efb32255-06ec-45cc-83c9-00b3f193252e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:12.284371 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-efb32255-06ec-45cc-83c9-00b3f193252e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:12.284857 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-efb32255-06ec-45cc-83c9-00b3f193252e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:12.285275 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-efb32255-06ec-45cc-83c9-00b3f193252e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:12.413211 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-efb32255-06ec-45cc-83c9-00b3f193252e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:12.421271 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-efb32255-06ec-45cc-83c9-00b3f193252e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:12.422695 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-efb32255-06ec-45cc-83c9-00b3f193252e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:12.423846 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-efb32255-06ec-45cc-83c9-00b3f193252e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1741 microversion: 2.20 time: 0.152775 Aug 31 01:25:12.424423 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 168/338] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:12 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1741 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 01:25:12.570597 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-02eb3455-a172-4b06-84f5-d540ced65442 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:12.571184 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-02eb3455-a172-4b06-84f5-d540ced65442 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] [instance: 0652e608-c1c4-41e6-949e-6c5a486e2979] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:12.577618 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-02eb3455-a172-4b06-84f5-d540ced65442 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:12.578099 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-02eb3455-a172-4b06-84f5-d540ced65442 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:12.578788 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-02eb3455-a172-4b06-84f5-d540ced65442 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:12.579481 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-02eb3455-a172-4b06-84f5-d540ced65442 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:12.579935 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-02eb3455-a172-4b06-84f5-d540ced65442 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:12.580379 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-02eb3455-a172-4b06-84f5-d540ced65442 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:12.712294 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-02eb3455-a172-4b06-84f5-d540ced65442 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f30ec33384ef483ee7bca27d4bb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac413264abe44918f2d1c65a365c063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:12.719987 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-02eb3455-a172-4b06-84f5-d540ced65442 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] 10.222.0.20 "GET /compute/v2.1/servers/0652e608-c1c4-41e6-949e-6c5a486e2979" status: 200 len: 1469 microversion: 2.1 time: 0.154032 Aug 31 01:25:12.720564 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 171/339] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:12 2022] GET /compute/v2.1/servers/0652e608-c1c4-41e6-949e-6c5a486e2979 => generated 1469 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:25:13.447063 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-0249733d-d49b-4ad1-b02d-9860151e201c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:13.447672 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-0249733d-d49b-4ad1-b02d-9860151e201c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:13.454352 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0249733d-d49b-4ad1-b02d-9860151e201c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:13.454831 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0249733d-d49b-4ad1-b02d-9860151e201c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:13.455267 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0249733d-d49b-4ad1-b02d-9860151e201c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:13.455950 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0249733d-d49b-4ad1-b02d-9860151e201c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:13.456923 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0249733d-d49b-4ad1-b02d-9860151e201c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:13.457340 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0249733d-d49b-4ad1-b02d-9860151e201c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:13.694693 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-0249733d-d49b-4ad1-b02d-9860151e201c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:13.705284 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-0249733d-d49b-4ad1-b02d-9860151e201c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:13.707613 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-0249733d-d49b-4ad1-b02d-9860151e201c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:13.709252 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-0249733d-d49b-4ad1-b02d-9860151e201c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1723 microversion: 2.20 time: 0.266107 Aug 31 01:25:13.721893 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 169/340] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:13 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1723 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:25:13.744307 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-0f47b6d7-52ed-4096-8c9f-f7bef5b49fb9 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:13.745976 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-0f47b6d7-52ed-4096-8c9f-f7bef5b49fb9 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] [instance: 0652e608-c1c4-41e6-949e-6c5a486e2979] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:13.755674 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0f47b6d7-52ed-4096-8c9f-f7bef5b49fb9 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:13.756191 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0f47b6d7-52ed-4096-8c9f-f7bef5b49fb9 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:13.756652 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0f47b6d7-52ed-4096-8c9f-f7bef5b49fb9 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:13.757489 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0f47b6d7-52ed-4096-8c9f-f7bef5b49fb9 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:13.757940 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0f47b6d7-52ed-4096-8c9f-f7bef5b49fb9 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:13.758361 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0f47b6d7-52ed-4096-8c9f-f7bef5b49fb9 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:13.966253 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-0f47b6d7-52ed-4096-8c9f-f7bef5b49fb9 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f30ec33384ef483ee7bca27d4bb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac413264abe44918f2d1c65a365c063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:13.974183 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-0f47b6d7-52ed-4096-8c9f-f7bef5b49fb9 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] 10.222.0.20 "GET /compute/v2.1/servers/0652e608-c1c4-41e6-949e-6c5a486e2979" status: 200 len: 1469 microversion: 2.1 time: 0.237050 Aug 31 01:25:13.974747 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 172/341] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:13 2022] GET /compute/v2.1/servers/0652e608-c1c4-41e6-949e-6c5a486e2979 => generated 1469 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:25:14.161035 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-560e5e61-3294-46e0-bb7f-8323193f0032 req-0b06ad30-4ce3-4593-a8fb-8c9bcae93837 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0652e608-c1c4-41e6-949e-6c5a486e2979", "name": "network-vif-deleted", "tag": "01016668-5bcb-48c2-a9e3-5491867dfd41"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:25:14.172132 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-560e5e61-3294-46e0-bb7f-8323193f0032 req-0b06ad30-4ce3-4593-a8fb-8c9bcae93837 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:14.172893 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-560e5e61-3294-46e0-bb7f-8323193f0032 req-0b06ad30-4ce3-4593-a8fb-8c9bcae93837 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:14.173509 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-560e5e61-3294-46e0-bb7f-8323193f0032 req-0b06ad30-4ce3-4593-a8fb-8c9bcae93837 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:14.188223 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-560e5e61-3294-46e0-bb7f-8323193f0032 req-0b06ad30-4ce3-4593-a8fb-8c9bcae93837 service nova] Creating event network-vif-deleted:01016668-5bcb-48c2-a9e3-5491867dfd41 for instance 0652e608-c1c4-41e6-949e-6c5a486e2979 on hv-cinder-85528 Aug 31 01:25:14.194512 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-560e5e61-3294-46e0-bb7f-8323193f0032 req-0b06ad30-4ce3-4593-a8fb-8c9bcae93837 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037473 Aug 31 01:25:14.195358 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 170/342] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:25:14.735083 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-a17f529b-8fbf-410b-8d8f-b00a6c210d2b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:14.735691 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-a17f529b-8fbf-410b-8d8f-b00a6c210d2b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:14.742269 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a17f529b-8fbf-410b-8d8f-b00a6c210d2b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:14.742756 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a17f529b-8fbf-410b-8d8f-b00a6c210d2b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:14.743192 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a17f529b-8fbf-410b-8d8f-b00a6c210d2b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:14.743871 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a17f529b-8fbf-410b-8d8f-b00a6c210d2b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:14.744323 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a17f529b-8fbf-410b-8d8f-b00a6c210d2b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:14.744881 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a17f529b-8fbf-410b-8d8f-b00a6c210d2b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:14.876971 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-a17f529b-8fbf-410b-8d8f-b00a6c210d2b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:14.885008 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-a17f529b-8fbf-410b-8d8f-b00a6c210d2b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:14.886449 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-a17f529b-8fbf-410b-8d8f-b00a6c210d2b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:14.887599 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-a17f529b-8fbf-410b-8d8f-b00a6c210d2b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1723 microversion: 2.20 time: 0.156479 Aug 31 01:25:14.888165 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 173/343] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:14 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:25:14.994841 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-14c7961f-bc75-45e7-bd10-af6316637eaf tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:14.995504 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-14c7961f-bc75-45e7-bd10-af6316637eaf tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] [instance: 0652e608-c1c4-41e6-949e-6c5a486e2979] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:15.002173 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-14c7961f-bc75-45e7-bd10-af6316637eaf tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:15.002654 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-14c7961f-bc75-45e7-bd10-af6316637eaf tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:15.003086 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-14c7961f-bc75-45e7-bd10-af6316637eaf tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:15.003771 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-14c7961f-bc75-45e7-bd10-af6316637eaf tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:15.004225 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-14c7961f-bc75-45e7-bd10-af6316637eaf tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:15.004675 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-14c7961f-bc75-45e7-bd10-af6316637eaf tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:15.065980 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-14c7961f-bc75-45e7-bd10-af6316637eaf tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f30ec33384ef483ee7bca27d4bb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac413264abe44918f2d1c65a365c063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:15.073532 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-14c7961f-bc75-45e7-bd10-af6316637eaf tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] 10.222.0.20 "GET /compute/v2.1/servers/0652e608-c1c4-41e6-949e-6c5a486e2979" status: 200 len: 1427 microversion: 2.1 time: 0.082983 Aug 31 01:25:15.074097 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 171/344] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:14 2022] GET /compute/v2.1/servers/0652e608-c1c4-41e6-949e-6c5a486e2979 => generated 1427 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:25:15.910898 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-3d1ebf13-dc64-4591-9b64-7f232ce7bb28 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:15.911506 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-3d1ebf13-dc64-4591-9b64-7f232ce7bb28 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:15.918141 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3d1ebf13-dc64-4591-9b64-7f232ce7bb28 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:15.918620 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3d1ebf13-dc64-4591-9b64-7f232ce7bb28 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:15.919058 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3d1ebf13-dc64-4591-9b64-7f232ce7bb28 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:15.919740 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3d1ebf13-dc64-4591-9b64-7f232ce7bb28 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:15.920191 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3d1ebf13-dc64-4591-9b64-7f232ce7bb28 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:15.920608 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3d1ebf13-dc64-4591-9b64-7f232ce7bb28 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:16.046376 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-3d1ebf13-dc64-4591-9b64-7f232ce7bb28 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:16.054962 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-3d1ebf13-dc64-4591-9b64-7f232ce7bb28 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:16.056391 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-3d1ebf13-dc64-4591-9b64-7f232ce7bb28 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:16.057580 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-3d1ebf13-dc64-4591-9b64-7f232ce7bb28 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1723 microversion: 2.20 time: 0.150682 Aug 31 01:25:16.058144 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 174/345] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:15 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:25:16.095168 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-063edb02-84f3-4502-b5f0-2e645a8ad2e2 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:16.095715 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-063edb02-84f3-4502-b5f0-2e645a8ad2e2 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] [instance: 0652e608-c1c4-41e6-949e-6c5a486e2979] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:16.102673 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-063edb02-84f3-4502-b5f0-2e645a8ad2e2 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:16.103154 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-063edb02-84f3-4502-b5f0-2e645a8ad2e2 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:16.103608 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-063edb02-84f3-4502-b5f0-2e645a8ad2e2 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:16.104293 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-063edb02-84f3-4502-b5f0-2e645a8ad2e2 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:16.104764 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-063edb02-84f3-4502-b5f0-2e645a8ad2e2 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:16.105187 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-063edb02-84f3-4502-b5f0-2e645a8ad2e2 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:16.168343 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-063edb02-84f3-4502-b5f0-2e645a8ad2e2 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f30ec33384ef483ee7bca27d4bb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac413264abe44918f2d1c65a365c063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:16.176494 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-063edb02-84f3-4502-b5f0-2e645a8ad2e2 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] 10.222.0.20 "GET /compute/v2.1/servers/0652e608-c1c4-41e6-949e-6c5a486e2979" status: 200 len: 1427 microversion: 2.1 time: 0.085151 Aug 31 01:25:16.177086 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 172/346] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:16 2022] GET /compute/v2.1/servers/0652e608-c1c4-41e6-949e-6c5a486e2979 => generated 1427 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:25:17.080091 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-b8cf216a-be81-4942-a985-03ee734be8ea tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:17.080625 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-b8cf216a-be81-4942-a985-03ee734be8ea tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:17.087082 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b8cf216a-be81-4942-a985-03ee734be8ea tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:17.087561 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b8cf216a-be81-4942-a985-03ee734be8ea tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:17.087995 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b8cf216a-be81-4942-a985-03ee734be8ea tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:17.088679 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b8cf216a-be81-4942-a985-03ee734be8ea tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:17.089160 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b8cf216a-be81-4942-a985-03ee734be8ea tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:17.089578 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b8cf216a-be81-4942-a985-03ee734be8ea tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:17.198080 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-9d321197-96e8-418e-a529-e0cf3708fb6c tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:17.198689 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-9d321197-96e8-418e-a529-e0cf3708fb6c tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] [instance: 0652e608-c1c4-41e6-949e-6c5a486e2979] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:17.205760 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9d321197-96e8-418e-a529-e0cf3708fb6c tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:17.206307 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9d321197-96e8-418e-a529-e0cf3708fb6c tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:17.206812 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9d321197-96e8-418e-a529-e0cf3708fb6c tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:17.208249 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9d321197-96e8-418e-a529-e0cf3708fb6c tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:17.208635 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9d321197-96e8-418e-a529-e0cf3708fb6c tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:17.209088 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9d321197-96e8-418e-a529-e0cf3708fb6c tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:17.222787 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-b8cf216a-be81-4942-a985-03ee734be8ea tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:17.231099 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-b8cf216a-be81-4942-a985-03ee734be8ea tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:17.232779 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-b8cf216a-be81-4942-a985-03ee734be8ea tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:17.234047 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-b8cf216a-be81-4942-a985-03ee734be8ea tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1723 microversion: 2.20 time: 0.158177 Aug 31 01:25:17.234842 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 175/347] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:17 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:25:17.276199 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-9d321197-96e8-418e-a529-e0cf3708fb6c tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f30ec33384ef483ee7bca27d4bb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac413264abe44918f2d1c65a365c063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:17.284158 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-9d321197-96e8-418e-a529-e0cf3708fb6c tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] 10.222.0.20 "GET /compute/v2.1/servers/0652e608-c1c4-41e6-949e-6c5a486e2979" status: 200 len: 1427 microversion: 2.1 time: 0.089973 Aug 31 01:25:17.284787 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 173/348] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:17 2022] GET /compute/v2.1/servers/0652e608-c1c4-41e6-949e-6c5a486e2979 => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:25:17.372801 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [req-863ed401-8787-4eac-8756-e74169ba6bc4 req-5ce4ac50-380b-4053-9247-f372e094dbe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12814f73-696a-4dc2-9182-7779bfe90ad5", "name": "network-vif-unplugged", "status": "completed", "tag": "dc60a507-f9d6-4b68-ae6c-65c2cfafb12c"}]} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:25:17.385842 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-863ed401-8787-4eac-8756-e74169ba6bc4 req-5ce4ac50-380b-4053-9247-f372e094dbe2 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:17.386373 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-863ed401-8787-4eac-8756-e74169ba6bc4 req-5ce4ac50-380b-4053-9247-f372e094dbe2 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:17.387011 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-863ed401-8787-4eac-8756-e74169ba6bc4 req-5ce4ac50-380b-4053-9247-f372e094dbe2 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:17.398488 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.compute.server_external_events [req-863ed401-8787-4eac-8756-e74169ba6bc4 req-5ce4ac50-380b-4053-9247-f372e094dbe2 service nova] Creating event network-vif-unplugged:dc60a507-f9d6-4b68-ae6c-65c2cfafb12c for instance 12814f73-696a-4dc2-9182-7779bfe90ad5 on hv-cinder-85528 Aug 31 01:25:17.403449 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [req-863ed401-8787-4eac-8756-e74169ba6bc4 req-5ce4ac50-380b-4053-9247-f372e094dbe2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034485 Aug 31 01:25:17.404091 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 176/349] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:25:17.828148 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-bc31a115-64d0-45dd-a607-c84aa9059812 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:17.828965 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-bc31a115-64d0-45dd-a607-c84aa9059812 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:17.835160 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-bc31a115-64d0-45dd-a607-c84aa9059812 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:17.835648 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-bc31a115-64d0-45dd-a607-c84aa9059812 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:17.836081 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-bc31a115-64d0-45dd-a607-c84aa9059812 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:17.837055 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-bc31a115-64d0-45dd-a607-c84aa9059812 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:17.837551 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-bc31a115-64d0-45dd-a607-c84aa9059812 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:17.837980 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-bc31a115-64d0-45dd-a607-c84aa9059812 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:17.862179 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-bc31a115-64d0-45dd-a607-c84aa9059812 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b/ips" status: 200 len: 146 microversion: 2.1 time: 0.037770 Aug 31 01:25:17.863502 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 174/350] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Aug 31 01:25:17 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:25:18.259719 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-376528bf-5ae1-479e-aa56-87e75dea8a03 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:18.261369 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-376528bf-5ae1-479e-aa56-87e75dea8a03 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:18.270572 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-376528bf-5ae1-479e-aa56-87e75dea8a03 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:18.271374 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-376528bf-5ae1-479e-aa56-87e75dea8a03 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:18.271975 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-376528bf-5ae1-479e-aa56-87e75dea8a03 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:18.272675 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-376528bf-5ae1-479e-aa56-87e75dea8a03 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:18.273392 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-376528bf-5ae1-479e-aa56-87e75dea8a03 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:18.274020 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-376528bf-5ae1-479e-aa56-87e75dea8a03 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:18.305704 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-323d7687-b5e4-4f00-98c6-1d942bc0d055 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:18.306317 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-323d7687-b5e4-4f00-98c6-1d942bc0d055 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] [instance: 0652e608-c1c4-41e6-949e-6c5a486e2979] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:18.314329 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-323d7687-b5e4-4f00-98c6-1d942bc0d055 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:18.315053 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-323d7687-b5e4-4f00-98c6-1d942bc0d055 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:18.315703 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-323d7687-b5e4-4f00-98c6-1d942bc0d055 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:18.316406 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-323d7687-b5e4-4f00-98c6-1d942bc0d055 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:18.316905 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-323d7687-b5e4-4f00-98c6-1d942bc0d055 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:18.321944 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-323d7687-b5e4-4f00-98c6-1d942bc0d055 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:18.353778 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-323d7687-b5e4-4f00-98c6-1d942bc0d055 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:18.354512 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-323d7687-b5e4-4f00-98c6-1d942bc0d055 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:18.354950 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-323d7687-b5e4-4f00-98c6-1d942bc0d055 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:18.355550 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.objects.instance [None req-323d7687-b5e4-4f00-98c6-1d942bc0d055 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lazy-loading 'fault' on Instance uuid 0652e608-c1c4-41e6-949e-6c5a486e2979 {{(pid=121025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:25:18.358606 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:25:18.417244 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-323d7687-b5e4-4f00-98c6-1d942bc0d055 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f30ec33384ef483ee7bca27d4bb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac413264abe44918f2d1c65a365c063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:18.427184 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-323d7687-b5e4-4f00-98c6-1d942bc0d055 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] 10.222.0.20 "GET /compute/v2.1/servers/0652e608-c1c4-41e6-949e-6c5a486e2979" status: 200 len: 1304 microversion: 2.1 time: 0.124942 Aug 31 01:25:18.428328 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 175/351] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:18 2022] GET /compute/v2.1/servers/0652e608-c1c4-41e6-949e-6c5a486e2979 => generated 1304 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:25:18.449953 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-376528bf-5ae1-479e-aa56-87e75dea8a03 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:18.458860 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-376528bf-5ae1-479e-aa56-87e75dea8a03 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:18.460301 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-376528bf-5ae1-479e-aa56-87e75dea8a03 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:18.461489 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-376528bf-5ae1-479e-aa56-87e75dea8a03 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1726 microversion: 2.20 time: 0.207575 Aug 31 01:25:18.462071 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 177/352] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:18 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1726 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:25:18.489060 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-cd967be8-f956-4198-8c48-01e3a4cd4ad6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "042bc048-0582-4108-9296-b7d6cd72dd9c"}} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:25:18.491368 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-cd967be8-f956-4198-8c48-01e3a4cd4ad6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:18.497559 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cd967be8-f956-4198-8c48-01e3a4cd4ad6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:18.498033 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cd967be8-f956-4198-8c48-01e3a4cd4ad6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:18.498463 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cd967be8-f956-4198-8c48-01e3a4cd4ad6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:18.499137 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cd967be8-f956-4198-8c48-01e3a4cd4ad6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:18.499582 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cd967be8-f956-4198-8c48-01e3a4cd4ad6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:18.499994 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cd967be8-f956-4198-8c48-01e3a4cd4ad6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:19.451555 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-b8bca3c6-240c-443a-8941-017c7c19b6d6 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:19.452162 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-b8bca3c6-240c-443a-8941-017c7c19b6d6 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] [instance: 0652e608-c1c4-41e6-949e-6c5a486e2979] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:19.458675 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b8bca3c6-240c-443a-8941-017c7c19b6d6 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:19.459163 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b8bca3c6-240c-443a-8941-017c7c19b6d6 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:19.461184 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b8bca3c6-240c-443a-8941-017c7c19b6d6 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:19.461184 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b8bca3c6-240c-443a-8941-017c7c19b6d6 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:19.461184 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b8bca3c6-240c-443a-8941-017c7c19b6d6 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:19.461184 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b8bca3c6-240c-443a-8941-017c7c19b6d6 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:19.474399 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.wsgi [None req-b8bca3c6-240c-443a-8941-017c7c19b6d6 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] HTTP exception thrown: Instance 0652e608-c1c4-41e6-949e-6c5a486e2979 could not be found. Aug 31 01:25:19.476017 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-b8bca3c6-240c-443a-8941-017c7c19b6d6 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Request method failure captured: Aug 31 01:25:19.476017 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: request: GET /compute/v2.1/servers/0652e608-c1c4-41e6-949e-6c5a486e2979 HTTP/1.1 Aug 31 01:25:19.476017 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept: application/json Aug 31 01:25:19.476017 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept-Encoding: identity Aug 31 01:25:19.476017 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Connection: close Aug 31 01:25:19.476017 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Length: 0 Aug 31 01:25:19.476017 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Type: application/json Aug 31 01:25:19.476017 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Host: 10.222.0.20 Aug 31 01:25:19.476017 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Openstack-System-Scope: None Aug 31 01:25:19.476017 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: User-Agent: python-urllib3/1.26.12 Aug 31 01:25:19.476017 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Auth-Token: gAAAAABjDrhlSGfYkRUKHbZdKlnEsG5eQfNmi4aiVGjkOaklCTTdP-8nY0thnrHSF1PqqGtoNo7G5kaHsxnQCtW7aT7vyG4cgZmRi-A3M16--Pz8guBugKsFqUIxN_R6XedkBFuvi2CN0xV8cqv0Nt8dDr7qkBYHCUKfdGyktCCEqUMYN6aXQdw Aug 31 01:25:19.476017 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Id: None Aug 31 01:25:19.476017 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Name: None Aug 31 01:25:19.476017 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Identity-Status: Confirmed Aug 31 01:25:19.476017 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Is-Admin-Project: True Aug 31 01:25:19.476017 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Id: default Aug 31 01:25:19.476017 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Name: Default Aug 31 01:25:19.476017 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Id: 6ac413264abe44918f2d1c65a365c063 Aug 31 01:25:19.476017 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Name: tempest-VolumesNegativeTest-2062849129 Aug 31 01:25:19.476017 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Role: member,reader Aug 31 01:25:19.476017 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Roles: member,reader Aug 31 01:25:19.477597 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6ac413264abe44918f2d1c65a365c063"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6ac413264abe44918f2d1c65a365c063", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6ac413264abe44918f2d1c65a365c063"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6ac413264abe44918f2d1c65a365c063"}]}] Aug 31 01:25:19.477597 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant: tempest-VolumesNegativeTest-2062849129 Aug 31 01:25:19.477597 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Id: 6ac413264abe44918f2d1c65a365c063 Aug 31 01:25:19.477597 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Name: tempest-VolumesNegativeTest-2062849129 Aug 31 01:25:19.477597 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User: tempest-VolumesNegativeTest-2062849129-project Aug 31 01:25:19.477597 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Id: default Aug 31 01:25:19.477597 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Name: Default Aug 31 01:25:19.477597 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Id: c87f30ec33384ef483ee7bca27d4bb54 Aug 31 01:25:19.477597 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Name: tempest-VolumesNegativeTest-2062849129-project Aug 31 01:25:19.477597 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: method: > Aug 31 01:25:19.477597 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: exception: Instance 0652e608-c1c4-41e6-949e-6c5a486e2979 could not be found. Aug 31 01:25:19.477597 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: action_args: {'id': '0652e608-c1c4-41e6-949e-6c5a486e2979'} Aug 31 01:25:19.478547 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:25:19.478547 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:25:19.478547 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:25:19.478547 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:25:19.478547 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:25:19.478547 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:25:19.478547 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:25:19.478547 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:25:19.478547 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:25:19.478547 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:25:19.478547 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0652e608-c1c4-41e6-949e-6c5a486e2979 could not be found. Aug 31 01:25:19.478547 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:25:19.478547 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:25:19.478547 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:25:19.478547 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:25:19.478547 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:25:19.478547 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:25:19.478547 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:25:19.478547 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:25:19.478547 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:25:19.479956 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:25:19.479956 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:25:19.479956 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:25:19.479956 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:25:19.479956 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:25:19.479956 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:25:19.479956 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:25:19.479956 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0652e608-c1c4-41e6-949e-6c5a486e2979 could not be found. Aug 31 01:25:19.479956 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:25:19.479956 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:25:19.479956 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:25:19.479956 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:25:19.479956 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:25:19.479956 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:25:19.479956 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:25:19.479956 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:25:19.479956 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0652e608-c1c4-41e6-949e-6c5a486e2979 could not be found. Aug 31 01:25:19.479956 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:25:19.483229 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-b8bca3c6-240c-443a-8941-017c7c19b6d6 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] Returning 404 to user: Instance 0652e608-c1c4-41e6-949e-6c5a486e2979 could not be found. {{(pid=121026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:25:19.483229 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-b8bca3c6-240c-443a-8941-017c7c19b6d6 tempest-VolumesNegativeTest-2062849129 tempest-VolumesNegativeTest-2062849129-project] 10.222.0.20 "GET /compute/v2.1/servers/0652e608-c1c4-41e6-949e-6c5a486e2979" status: 404 len: 111 microversion: 2.1 time: 0.029746 Aug 31 01:25:19.483229 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 178/353] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:19 2022] GET /compute/v2.1/servers/0652e608-c1c4-41e6-949e-6c5a486e2979 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 01:25:19.668487 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-cd967be8-f956-4198-8c48-01e3a4cd4ad6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "POST /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.184590 Aug 31 01:25:19.669137 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 176/354] 10.222.0.20 () {62 vars in 1364 bytes} [Wed Aug 31 01:25:18 2022] POST /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5/os-volume_attachments => generated 188 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 01:25:19.799118 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-ac1aa202-bdd4-43b6-94c9-b8c8e8c2af50 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:25:19.799721 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-ac1aa202-bdd4-43b6-94c9-b8c8e8c2af50 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:19.806526 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ac1aa202-bdd4-43b6-94c9-b8c8e8c2af50 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:19.807020 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ac1aa202-bdd4-43b6-94c9-b8c8e8c2af50 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:19.807464 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ac1aa202-bdd4-43b6-94c9-b8c8e8c2af50 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:19.808144 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ac1aa202-bdd4-43b6-94c9-b8c8e8c2af50 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:19.808786 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ac1aa202-bdd4-43b6-94c9-b8c8e8c2af50 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:19.809442 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ac1aa202-bdd4-43b6-94c9-b8c8e8c2af50 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:19.855789 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-ac1aa202-bdd4-43b6-94c9-b8c8e8c2af50 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121026) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 01:25:20.186289 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-ac1aa202-bdd4-43b6-94c9-b8c8e8c2af50 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "POST /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5/action" status: 202 len: 0 microversion: 2.20 time: 0.390975 Aug 31 01:25:20.186915 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 179/355] 10.222.0.20 () {62 vars in 1319 bytes} [Wed Aug 31 01:25:19 2022] POST /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5/action => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 01:25:20.195668 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-a85a4d7f-d802-4575-a3bf-908da0a8e030 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:20.196395 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-a85a4d7f-d802-4575-a3bf-908da0a8e030 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:20.205671 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a85a4d7f-d802-4575-a3bf-908da0a8e030 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:20.206840 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a85a4d7f-d802-4575-a3bf-908da0a8e030 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:20.207280 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a85a4d7f-d802-4575-a3bf-908da0a8e030 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:20.207979 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a85a4d7f-d802-4575-a3bf-908da0a8e030 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:20.208432 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a85a4d7f-d802-4575-a3bf-908da0a8e030 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:20.209057 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a85a4d7f-d802-4575-a3bf-908da0a8e030 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:20.343899 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-a85a4d7f-d802-4575-a3bf-908da0a8e030 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:20.354009 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-a85a4d7f-d802-4575-a3bf-908da0a8e030 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:20.355418 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-a85a4d7f-d802-4575-a3bf-908da0a8e030 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:20.356631 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-a85a4d7f-d802-4575-a3bf-908da0a8e030 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1752 microversion: 2.20 time: 0.165600 Aug 31 01:25:20.357231 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 177/356] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:20 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:25:21.014485 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-7e10bbcd-5d6b-4e37-881a-3bf40d0f31f6 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5c363c8-7ed0-4662-bdc2-727063f7467f"}} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:25:21.017451 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-7e10bbcd-5d6b-4e37-881a-3bf40d0f31f6 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:21.026505 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7e10bbcd-5d6b-4e37-881a-3bf40d0f31f6 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:21.027185 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7e10bbcd-5d6b-4e37-881a-3bf40d0f31f6 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:21.027746 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7e10bbcd-5d6b-4e37-881a-3bf40d0f31f6 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:21.028678 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7e10bbcd-5d6b-4e37-881a-3bf40d0f31f6 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:21.029164 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7e10bbcd-5d6b-4e37-881a-3bf40d0f31f6 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:21.029597 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7e10bbcd-5d6b-4e37-881a-3bf40d0f31f6 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:21.380945 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-87b087c7-9afa-446b-9cab-37361fd3aeee tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:21.381792 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-87b087c7-9afa-446b-9cab-37361fd3aeee tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:21.389500 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-87b087c7-9afa-446b-9cab-37361fd3aeee tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:21.390091 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-87b087c7-9afa-446b-9cab-37361fd3aeee tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:21.390635 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-87b087c7-9afa-446b-9cab-37361fd3aeee tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:21.391462 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-87b087c7-9afa-446b-9cab-37361fd3aeee tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:21.392176 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-87b087c7-9afa-446b-9cab-37361fd3aeee tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:21.392705 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-87b087c7-9afa-446b-9cab-37361fd3aeee tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:21.540049 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-87b087c7-9afa-446b-9cab-37361fd3aeee tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:21.549286 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-87b087c7-9afa-446b-9cab-37361fd3aeee tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:21.551376 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-87b087c7-9afa-446b-9cab-37361fd3aeee tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:21.552528 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-87b087c7-9afa-446b-9cab-37361fd3aeee tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1752 microversion: 2.20 time: 0.176333 Aug 31 01:25:21.553112 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 178/357] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:21 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1752 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:25:22.010413 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-7e10bbcd-5d6b-4e37-881a-3bf40d0f31f6 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "POST /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.000295 Aug 31 01:25:22.011024 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 180/358] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 31 01:25:21 2022] POST /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b/os-volume_attachments => generated 194 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:25:22.576262 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-ef23b40f-ee9a-4bf3-bd69-a4257ab14ab0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:22.576917 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-ef23b40f-ee9a-4bf3-bd69-a4257ab14ab0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:22.583625 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ef23b40f-ee9a-4bf3-bd69-a4257ab14ab0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:22.584124 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ef23b40f-ee9a-4bf3-bd69-a4257ab14ab0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:22.584535 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ef23b40f-ee9a-4bf3-bd69-a4257ab14ab0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:22.585243 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ef23b40f-ee9a-4bf3-bd69-a4257ab14ab0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:22.585816 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ef23b40f-ee9a-4bf3-bd69-a4257ab14ab0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:22.586232 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ef23b40f-ee9a-4bf3-bd69-a4257ab14ab0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:22.724980 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-ef23b40f-ee9a-4bf3-bd69-a4257ab14ab0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:22.733951 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-ef23b40f-ee9a-4bf3-bd69-a4257ab14ab0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:22.735967 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-ef23b40f-ee9a-4bf3-bd69-a4257ab14ab0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:22.737153 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-ef23b40f-ee9a-4bf3-bd69-a4257ab14ab0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1754 microversion: 2.20 time: 0.164887 Aug 31 01:25:22.737792 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 179/359] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:22 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:25:23.768317 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-26dc6c24-b57a-4596-a38d-0d2b246f29f4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:23.769287 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-26dc6c24-b57a-4596-a38d-0d2b246f29f4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:23.775413 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-26dc6c24-b57a-4596-a38d-0d2b246f29f4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:23.775947 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-26dc6c24-b57a-4596-a38d-0d2b246f29f4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:23.776444 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-26dc6c24-b57a-4596-a38d-0d2b246f29f4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:23.777231 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-26dc6c24-b57a-4596-a38d-0d2b246f29f4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:23.777743 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-26dc6c24-b57a-4596-a38d-0d2b246f29f4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:23.778227 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-26dc6c24-b57a-4596-a38d-0d2b246f29f4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:23.914496 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-26dc6c24-b57a-4596-a38d-0d2b246f29f4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:23.922768 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-26dc6c24-b57a-4596-a38d-0d2b246f29f4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:23.924315 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-26dc6c24-b57a-4596-a38d-0d2b246f29f4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:23.925534 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-26dc6c24-b57a-4596-a38d-0d2b246f29f4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1754 microversion: 2.20 time: 0.161981 Aug 31 01:25:23.926093 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 181/360] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:23 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:25:24.949964 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-d330a27d-ed9d-4c9f-9743-7eb01ffca16f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:24.950575 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-d330a27d-ed9d-4c9f-9743-7eb01ffca16f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:24.957667 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d330a27d-ed9d-4c9f-9743-7eb01ffca16f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:24.958223 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d330a27d-ed9d-4c9f-9743-7eb01ffca16f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:24.958658 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d330a27d-ed9d-4c9f-9743-7eb01ffca16f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:24.959351 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d330a27d-ed9d-4c9f-9743-7eb01ffca16f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:24.959804 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d330a27d-ed9d-4c9f-9743-7eb01ffca16f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:24.960226 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d330a27d-ed9d-4c9f-9743-7eb01ffca16f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:25.095734 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-d330a27d-ed9d-4c9f-9743-7eb01ffca16f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:25.104738 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-d330a27d-ed9d-4c9f-9743-7eb01ffca16f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:25.106249 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-d330a27d-ed9d-4c9f-9743-7eb01ffca16f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:25.107549 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-d330a27d-ed9d-4c9f-9743-7eb01ffca16f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1754 microversion: 2.20 time: 0.161741 Aug 31 01:25:25.108139 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 180/361] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:24 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:25:26.131899 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-0cdb8ed7-621d-45cb-a505-45b84b747046 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:26.136835 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-0cdb8ed7-621d-45cb-a505-45b84b747046 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:26.139209 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0cdb8ed7-621d-45cb-a505-45b84b747046 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:26.139701 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0cdb8ed7-621d-45cb-a505-45b84b747046 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:26.140144 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0cdb8ed7-621d-45cb-a505-45b84b747046 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:26.140891 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0cdb8ed7-621d-45cb-a505-45b84b747046 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:26.141437 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0cdb8ed7-621d-45cb-a505-45b84b747046 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:26.141857 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0cdb8ed7-621d-45cb-a505-45b84b747046 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:26.279130 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-0cdb8ed7-621d-45cb-a505-45b84b747046 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:26.292005 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-0cdb8ed7-621d-45cb-a505-45b84b747046 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:26.294177 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-0cdb8ed7-621d-45cb-a505-45b84b747046 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:26.295635 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-0cdb8ed7-621d-45cb-a505-45b84b747046 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1754 microversion: 2.20 time: 0.168250 Aug 31 01:25:26.296353 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 182/362] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:26 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:25:27.321341 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-37d2b404-1c29-4615-979f-5c48c6e2da18 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:27.321946 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-37d2b404-1c29-4615-979f-5c48c6e2da18 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:27.324400 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:25:27.329881 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-37d2b404-1c29-4615-979f-5c48c6e2da18 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:27.330407 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-37d2b404-1c29-4615-979f-5c48c6e2da18 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:27.330843 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-37d2b404-1c29-4615-979f-5c48c6e2da18 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:27.331542 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-37d2b404-1c29-4615-979f-5c48c6e2da18 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:27.332019 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-37d2b404-1c29-4615-979f-5c48c6e2da18 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:27.332439 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-37d2b404-1c29-4615-979f-5c48c6e2da18 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:27.467390 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-37d2b404-1c29-4615-979f-5c48c6e2da18 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:27.476366 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-37d2b404-1c29-4615-979f-5c48c6e2da18 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:27.477812 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-37d2b404-1c29-4615-979f-5c48c6e2da18 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:27.478964 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-37d2b404-1c29-4615-979f-5c48c6e2da18 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1754 microversion: 2.20 time: 0.162096 Aug 31 01:25:27.479526 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 181/363] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:27 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:25:28.501920 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-deba3e70-b7e4-4531-b38d-731c5ce470fc tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:28.502525 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-deba3e70-b7e4-4531-b38d-731c5ce470fc tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:28.510027 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-deba3e70-b7e4-4531-b38d-731c5ce470fc tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:28.510443 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-deba3e70-b7e4-4531-b38d-731c5ce470fc tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:28.510886 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-deba3e70-b7e4-4531-b38d-731c5ce470fc tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:28.511556 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-deba3e70-b7e4-4531-b38d-731c5ce470fc tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:28.512008 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-deba3e70-b7e4-4531-b38d-731c5ce470fc tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:28.512428 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-deba3e70-b7e4-4531-b38d-731c5ce470fc tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:28.516528 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:25:28.654019 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-deba3e70-b7e4-4531-b38d-731c5ce470fc tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:28.663355 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-deba3e70-b7e4-4531-b38d-731c5ce470fc tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:28.664787 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-deba3e70-b7e4-4531-b38d-731c5ce470fc tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:28.666050 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-deba3e70-b7e4-4531-b38d-731c5ce470fc tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1754 microversion: 2.20 time: 0.167917 Aug 31 01:25:28.666575 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 183/364] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:28 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:25:29.563063 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-7069843f-c4c8-402f-98db-e4a12869989a tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:25:29.570124 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7069843f-c4c8-402f-98db-e4a12869989a tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:29.570612 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7069843f-c4c8-402f-98db-e4a12869989a tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:29.571044 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7069843f-c4c8-402f-98db-e4a12869989a tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:29.633672 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-7069843f-c4c8-402f-98db-e4a12869989a tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Going to try to stop instance {{(pid=121025) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 01:25:29.690177 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-e53cee40-7d41-4303-be7b-e01001b59b72 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:29.690724 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-e53cee40-7d41-4303-be7b-e01001b59b72 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:29.698544 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e53cee40-7d41-4303-be7b-e01001b59b72 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:29.699027 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e53cee40-7d41-4303-be7b-e01001b59b72 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:29.700354 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e53cee40-7d41-4303-be7b-e01001b59b72 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:29.701593 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e53cee40-7d41-4303-be7b-e01001b59b72 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:29.702043 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e53cee40-7d41-4303-be7b-e01001b59b72 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:29.702489 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e53cee40-7d41-4303-be7b-e01001b59b72 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:29.837255 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-e53cee40-7d41-4303-be7b-e01001b59b72 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:29.846420 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-e53cee40-7d41-4303-be7b-e01001b59b72 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:29.847909 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-e53cee40-7d41-4303-be7b-e01001b59b72 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:29.849230 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-e53cee40-7d41-4303-be7b-e01001b59b72 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1754 microversion: 2.20 time: 0.163442 Aug 31 01:25:29.849949 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 184/365] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:29 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 01:25:29.878468 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-7069843f-c4c8-402f-98db-e4a12869989a tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "POST /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b/action" status: 202 len: 0 microversion: 2.1 time: 0.318808 Aug 31 01:25:29.884695 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 182/366] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 31 01:25:29 2022] POST /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 01:25:29.888044 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-fb4c84e6-7b88-46d7-93c1-710b1a211bd0 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:29.888825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-fb4c84e6-7b88-46d7-93c1-710b1a211bd0 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:29.899057 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fb4c84e6-7b88-46d7-93c1-710b1a211bd0 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:29.899666 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fb4c84e6-7b88-46d7-93c1-710b1a211bd0 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:29.900233 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fb4c84e6-7b88-46d7-93c1-710b1a211bd0 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:29.901626 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fb4c84e6-7b88-46d7-93c1-710b1a211bd0 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:29.902068 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fb4c84e6-7b88-46d7-93c1-710b1a211bd0 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:29.904971 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fb4c84e6-7b88-46d7-93c1-710b1a211bd0 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:30.043460 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-fb4c84e6-7b88-46d7-93c1-710b1a211bd0 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:30.052619 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-fb4c84e6-7b88-46d7-93c1-710b1a211bd0 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1724 microversion: 2.1 time: 0.168077 Aug 31 01:25:30.053356 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 185/367] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:29 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:25:30.873039 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-c51e70e7-df8a-4aa0-9a78-345b54f115ac tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:30.873737 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-c51e70e7-df8a-4aa0-9a78-345b54f115ac tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:30.880858 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c51e70e7-df8a-4aa0-9a78-345b54f115ac tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:30.881339 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c51e70e7-df8a-4aa0-9a78-345b54f115ac tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:30.881772 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c51e70e7-df8a-4aa0-9a78-345b54f115ac tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:30.882456 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c51e70e7-df8a-4aa0-9a78-345b54f115ac tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:30.882909 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c51e70e7-df8a-4aa0-9a78-345b54f115ac tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:30.883331 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c51e70e7-df8a-4aa0-9a78-345b54f115ac tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:31.017048 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-c51e70e7-df8a-4aa0-9a78-345b54f115ac tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:31.027019 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-c51e70e7-df8a-4aa0-9a78-345b54f115ac tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:31.028451 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-c51e70e7-df8a-4aa0-9a78-345b54f115ac tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:31.029654 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-c51e70e7-df8a-4aa0-9a78-345b54f115ac tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1810 microversion: 2.20 time: 0.160892 Aug 31 01:25:31.030209 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 183/368] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:30 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:25:31.074790 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-f7a5f910-5db6-41dc-9456-0f9a2c2907b8 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:31.075391 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-f7a5f910-5db6-41dc-9456-0f9a2c2907b8 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:31.077832 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:25:31.082869 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f7a5f910-5db6-41dc-9456-0f9a2c2907b8 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:31.083908 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f7a5f910-5db6-41dc-9456-0f9a2c2907b8 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:31.084347 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f7a5f910-5db6-41dc-9456-0f9a2c2907b8 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:31.085056 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f7a5f910-5db6-41dc-9456-0f9a2c2907b8 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:31.085532 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f7a5f910-5db6-41dc-9456-0f9a2c2907b8 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:31.085953 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f7a5f910-5db6-41dc-9456-0f9a2c2907b8 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:31.224693 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-f7a5f910-5db6-41dc-9456-0f9a2c2907b8 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:31.233266 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-f7a5f910-5db6-41dc-9456-0f9a2c2907b8 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1724 microversion: 2.1 time: 0.162430 Aug 31 01:25:31.233834 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 186/369] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:31 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:25:32.052997 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-11ce8ada-69a6-4317-bbcc-5de0d92c81cf tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:32.053623 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-11ce8ada-69a6-4317-bbcc-5de0d92c81cf tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:32.060024 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-11ce8ada-69a6-4317-bbcc-5de0d92c81cf tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:32.060444 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-11ce8ada-69a6-4317-bbcc-5de0d92c81cf tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:32.060905 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-11ce8ada-69a6-4317-bbcc-5de0d92c81cf tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:32.061592 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-11ce8ada-69a6-4317-bbcc-5de0d92c81cf tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:32.062044 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-11ce8ada-69a6-4317-bbcc-5de0d92c81cf tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:32.062454 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-11ce8ada-69a6-4317-bbcc-5de0d92c81cf tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:32.255440 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-7337e6e0-d76b-473a-a0eb-ac092cb68298 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:32.256024 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-7337e6e0-d76b-473a-a0eb-ac092cb68298 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:32.262376 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7337e6e0-d76b-473a-a0eb-ac092cb68298 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:32.262860 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7337e6e0-d76b-473a-a0eb-ac092cb68298 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:32.263290 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7337e6e0-d76b-473a-a0eb-ac092cb68298 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:32.263981 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7337e6e0-d76b-473a-a0eb-ac092cb68298 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:32.264427 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7337e6e0-d76b-473a-a0eb-ac092cb68298 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:32.264880 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7337e6e0-d76b-473a-a0eb-ac092cb68298 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:32.268539 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-11ce8ada-69a6-4317-bbcc-5de0d92c81cf tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:32.278724 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-11ce8ada-69a6-4317-bbcc-5de0d92c81cf tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:32.280149 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-11ce8ada-69a6-4317-bbcc-5de0d92c81cf tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:32.281342 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-11ce8ada-69a6-4317-bbcc-5de0d92c81cf tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1810 microversion: 2.20 time: 0.232391 Aug 31 01:25:32.281895 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 184/370] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:32 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1810 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:25:32.400780 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-7337e6e0-d76b-473a-a0eb-ac092cb68298 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:32.409111 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-7337e6e0-d76b-473a-a0eb-ac092cb68298 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1724 microversion: 2.1 time: 0.157681 Aug 31 01:25:32.409667 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 187/371] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:32 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:25:33.306371 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-95a55587-5d02-400e-8e7f-1c95d8e9c61f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:33.306911 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-95a55587-5d02-400e-8e7f-1c95d8e9c61f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:33.313535 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-95a55587-5d02-400e-8e7f-1c95d8e9c61f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:33.314106 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-95a55587-5d02-400e-8e7f-1c95d8e9c61f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:33.314547 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-95a55587-5d02-400e-8e7f-1c95d8e9c61f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:33.315249 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-95a55587-5d02-400e-8e7f-1c95d8e9c61f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:33.315843 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-95a55587-5d02-400e-8e7f-1c95d8e9c61f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:33.316777 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-95a55587-5d02-400e-8e7f-1c95d8e9c61f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:33.430843 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-78c9ed48-fe8d-4164-abbb-726188fd29b2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:33.431454 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-78c9ed48-fe8d-4164-abbb-726188fd29b2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:33.438589 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-78c9ed48-fe8d-4164-abbb-726188fd29b2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:33.439083 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-78c9ed48-fe8d-4164-abbb-726188fd29b2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:33.439515 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-78c9ed48-fe8d-4164-abbb-726188fd29b2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:33.440222 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-78c9ed48-fe8d-4164-abbb-726188fd29b2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:33.440681 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-78c9ed48-fe8d-4164-abbb-726188fd29b2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:33.441144 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-78c9ed48-fe8d-4164-abbb-726188fd29b2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:33.468617 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-95a55587-5d02-400e-8e7f-1c95d8e9c61f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:33.478150 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-95a55587-5d02-400e-8e7f-1c95d8e9c61f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:33.479861 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-95a55587-5d02-400e-8e7f-1c95d8e9c61f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:33.481052 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-95a55587-5d02-400e-8e7f-1c95d8e9c61f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1810 microversion: 2.20 time: 0.179461 Aug 31 01:25:33.481604 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 185/372] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:33 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1810 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:25:33.609119 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-78c9ed48-fe8d-4164-abbb-726188fd29b2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:33.619905 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-78c9ed48-fe8d-4164-abbb-726188fd29b2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1724 microversion: 2.1 time: 0.193294 Aug 31 01:25:33.621034 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 188/373] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:33 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:25:34.506339 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-cd98a467-8373-4206-b4d0-16b97987372b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:34.506963 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-cd98a467-8373-4206-b4d0-16b97987372b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:34.514133 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cd98a467-8373-4206-b4d0-16b97987372b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:34.514639 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cd98a467-8373-4206-b4d0-16b97987372b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:34.515279 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cd98a467-8373-4206-b4d0-16b97987372b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:34.515985 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cd98a467-8373-4206-b4d0-16b97987372b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:34.516582 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cd98a467-8373-4206-b4d0-16b97987372b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:34.517321 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cd98a467-8373-4206-b4d0-16b97987372b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:34.642139 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-47e82b6e-487d-483f-b5e0-be66409a0813 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:34.643506 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-47e82b6e-487d-483f-b5e0-be66409a0813 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:34.657739 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-47e82b6e-487d-483f-b5e0-be66409a0813 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:34.658061 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-cd98a467-8373-4206-b4d0-16b97987372b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:34.659074 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-47e82b6e-487d-483f-b5e0-be66409a0813 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:34.659877 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-47e82b6e-487d-483f-b5e0-be66409a0813 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:34.661457 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-47e82b6e-487d-483f-b5e0-be66409a0813 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:34.663287 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-47e82b6e-487d-483f-b5e0-be66409a0813 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:34.663714 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-47e82b6e-487d-483f-b5e0-be66409a0813 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:34.668682 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-cd98a467-8373-4206-b4d0-16b97987372b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:34.670167 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-cd98a467-8373-4206-b4d0-16b97987372b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:34.671382 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-cd98a467-8373-4206-b4d0-16b97987372b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1810 microversion: 2.20 time: 0.169620 Aug 31 01:25:34.671971 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 186/374] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:34 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:25:34.813019 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-47e82b6e-487d-483f-b5e0-be66409a0813 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:34.821406 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-47e82b6e-487d-483f-b5e0-be66409a0813 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1724 microversion: 2.1 time: 0.183358 Aug 31 01:25:34.822245 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 189/375] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:34 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:25:35.696007 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-94fcc7db-eb0d-4ab4-a86e-e58b2175799c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:35.696619 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-94fcc7db-eb0d-4ab4-a86e-e58b2175799c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:35.703215 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-94fcc7db-eb0d-4ab4-a86e-e58b2175799c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:35.703958 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-94fcc7db-eb0d-4ab4-a86e-e58b2175799c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:35.704395 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-94fcc7db-eb0d-4ab4-a86e-e58b2175799c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:35.705157 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-94fcc7db-eb0d-4ab4-a86e-e58b2175799c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:35.705608 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-94fcc7db-eb0d-4ab4-a86e-e58b2175799c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:35.706027 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-94fcc7db-eb0d-4ab4-a86e-e58b2175799c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:35.842893 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-31a2ceb3-5f82-4930-b025-5100e8bf291e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:35.844702 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-31a2ceb3-5f82-4930-b025-5100e8bf291e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:35.851979 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-31a2ceb3-5f82-4930-b025-5100e8bf291e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:35.852394 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-31a2ceb3-5f82-4930-b025-5100e8bf291e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:35.853065 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-31a2ceb3-5f82-4930-b025-5100e8bf291e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:35.853907 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-31a2ceb3-5f82-4930-b025-5100e8bf291e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:35.854523 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-31a2ceb3-5f82-4930-b025-5100e8bf291e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:35.854991 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-31a2ceb3-5f82-4930-b025-5100e8bf291e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:35.870102 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-94fcc7db-eb0d-4ab4-a86e-e58b2175799c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:35.883003 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-94fcc7db-eb0d-4ab4-a86e-e58b2175799c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:35.884471 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-94fcc7db-eb0d-4ab4-a86e-e58b2175799c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:35.896784 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-94fcc7db-eb0d-4ab4-a86e-e58b2175799c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1810 microversion: 2.20 time: 0.194290 Aug 31 01:25:35.907402 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 187/376] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:35 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1810 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:25:36.016809 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-31a2ceb3-5f82-4930-b025-5100e8bf291e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:36.025832 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-31a2ceb3-5f82-4930-b025-5100e8bf291e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1724 microversion: 2.1 time: 0.186915 Aug 31 01:25:36.029789 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 190/377] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:35 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:25:36.911824 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-424cdbc2-98e1-4e37-98d7-cfa859a89a6c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:36.912428 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-424cdbc2-98e1-4e37-98d7-cfa859a89a6c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:36.919447 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-424cdbc2-98e1-4e37-98d7-cfa859a89a6c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:36.919937 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-424cdbc2-98e1-4e37-98d7-cfa859a89a6c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:36.920371 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-424cdbc2-98e1-4e37-98d7-cfa859a89a6c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:36.921098 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-424cdbc2-98e1-4e37-98d7-cfa859a89a6c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:36.921548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-424cdbc2-98e1-4e37-98d7-cfa859a89a6c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:36.921964 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-424cdbc2-98e1-4e37-98d7-cfa859a89a6c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:36.940469 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:25:37.047563 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-c7d0ee53-eb30-4e2e-b3f5-89e2af677563 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:37.048166 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-c7d0ee53-eb30-4e2e-b3f5-89e2af677563 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:37.055130 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c7d0ee53-eb30-4e2e-b3f5-89e2af677563 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:37.055623 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c7d0ee53-eb30-4e2e-b3f5-89e2af677563 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:37.056086 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c7d0ee53-eb30-4e2e-b3f5-89e2af677563 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:37.056844 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c7d0ee53-eb30-4e2e-b3f5-89e2af677563 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:37.057300 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c7d0ee53-eb30-4e2e-b3f5-89e2af677563 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:37.070430 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-424cdbc2-98e1-4e37-98d7-cfa859a89a6c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:37.072781 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c7d0ee53-eb30-4e2e-b3f5-89e2af677563 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:37.080988 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-424cdbc2-98e1-4e37-98d7-cfa859a89a6c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:37.082679 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-424cdbc2-98e1-4e37-98d7-cfa859a89a6c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:37.084516 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-424cdbc2-98e1-4e37-98d7-cfa859a89a6c tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1810 microversion: 2.20 time: 0.176662 Aug 31 01:25:37.085279 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 188/378] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:36 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1810 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:25:37.214233 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-c7d0ee53-eb30-4e2e-b3f5-89e2af677563 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:37.223356 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-c7d0ee53-eb30-4e2e-b3f5-89e2af677563 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1724 microversion: 2.1 time: 0.179957 Aug 31 01:25:37.224124 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 191/379] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:37 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:25:38.107563 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-66c4c5c6-b807-4345-b6b2-dbae24e5abef tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:38.108411 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-66c4c5c6-b807-4345-b6b2-dbae24e5abef tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:38.114866 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-66c4c5c6-b807-4345-b6b2-dbae24e5abef tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:38.115346 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-66c4c5c6-b807-4345-b6b2-dbae24e5abef tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:38.115781 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-66c4c5c6-b807-4345-b6b2-dbae24e5abef tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:38.116606 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-66c4c5c6-b807-4345-b6b2-dbae24e5abef tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:38.117110 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-66c4c5c6-b807-4345-b6b2-dbae24e5abef tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:38.117520 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-66c4c5c6-b807-4345-b6b2-dbae24e5abef tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:38.245183 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-39f1482f-b1f6-4807-bd6f-80fab75ed9d9 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:38.245791 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-39f1482f-b1f6-4807-bd6f-80fab75ed9d9 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:38.251756 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-39f1482f-b1f6-4807-bd6f-80fab75ed9d9 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:38.252237 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-39f1482f-b1f6-4807-bd6f-80fab75ed9d9 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:38.252665 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-39f1482f-b1f6-4807-bd6f-80fab75ed9d9 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:38.253394 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-39f1482f-b1f6-4807-bd6f-80fab75ed9d9 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:38.253847 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-39f1482f-b1f6-4807-bd6f-80fab75ed9d9 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:38.254264 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-39f1482f-b1f6-4807-bd6f-80fab75ed9d9 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:38.267036 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-66c4c5c6-b807-4345-b6b2-dbae24e5abef tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:38.276851 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-66c4c5c6-b807-4345-b6b2-dbae24e5abef tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:38.278767 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-66c4c5c6-b807-4345-b6b2-dbae24e5abef tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:38.280006 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-66c4c5c6-b807-4345-b6b2-dbae24e5abef tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1810 microversion: 2.20 time: 0.176455 Aug 31 01:25:38.288768 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 189/380] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:38 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1810 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:25:38.401984 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-39f1482f-b1f6-4807-bd6f-80fab75ed9d9 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:38.415017 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-39f1482f-b1f6-4807-bd6f-80fab75ed9d9 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1724 microversion: 2.1 time: 0.174166 Aug 31 01:25:38.415596 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 192/381] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:38 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:25:39.305204 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-5aed5bc0-4e1a-4dad-974f-b17d0bbfb83e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:39.305870 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-5aed5bc0-4e1a-4dad-974f-b17d0bbfb83e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:39.312953 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5aed5bc0-4e1a-4dad-974f-b17d0bbfb83e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:39.313760 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5aed5bc0-4e1a-4dad-974f-b17d0bbfb83e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:39.314162 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5aed5bc0-4e1a-4dad-974f-b17d0bbfb83e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:39.314903 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5aed5bc0-4e1a-4dad-974f-b17d0bbfb83e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:39.315333 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5aed5bc0-4e1a-4dad-974f-b17d0bbfb83e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:39.315759 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5aed5bc0-4e1a-4dad-974f-b17d0bbfb83e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:39.436952 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-319e20bd-a8a0-4284-ac48-756c6ceccacc tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:39.437852 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-319e20bd-a8a0-4284-ac48-756c6ceccacc tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:39.444498 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-319e20bd-a8a0-4284-ac48-756c6ceccacc tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:39.445280 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-319e20bd-a8a0-4284-ac48-756c6ceccacc tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:39.446012 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-319e20bd-a8a0-4284-ac48-756c6ceccacc tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:39.446901 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-319e20bd-a8a0-4284-ac48-756c6ceccacc tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:39.447365 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-319e20bd-a8a0-4284-ac48-756c6ceccacc tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:39.447822 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-319e20bd-a8a0-4284-ac48-756c6ceccacc tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:39.463915 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-5aed5bc0-4e1a-4dad-974f-b17d0bbfb83e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:39.473582 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-5aed5bc0-4e1a-4dad-974f-b17d0bbfb83e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:39.476025 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-5aed5bc0-4e1a-4dad-974f-b17d0bbfb83e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:39.477399 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-5aed5bc0-4e1a-4dad-974f-b17d0bbfb83e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1810 microversion: 2.20 time: 0.176875 Aug 31 01:25:39.478179 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 190/382] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:39 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1810 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:25:39.582752 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-319e20bd-a8a0-4284-ac48-756c6ceccacc tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:39.596706 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-319e20bd-a8a0-4284-ac48-756c6ceccacc tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1724 microversion: 2.1 time: 0.163885 Aug 31 01:25:39.597777 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 193/383] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:39 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:25:39.650397 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-df3c5c66-c748-44c4-b111-f989cbbb75a3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:39.650979 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-df3c5c66-c748-44c4-b111-f989cbbb75a3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 082d7637-9b1c-469c-b688-c76ca61e9f6b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:39.657463 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-df3c5c66-c748-44c4-b111-f989cbbb75a3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:39.657950 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-df3c5c66-c748-44c4-b111-f989cbbb75a3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:39.658387 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-df3c5c66-c748-44c4-b111-f989cbbb75a3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:39.659205 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-df3c5c66-c748-44c4-b111-f989cbbb75a3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:39.659834 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-df3c5c66-c748-44c4-b111-f989cbbb75a3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:39.660260 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-df3c5c66-c748-44c4-b111-f989cbbb75a3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:39.684698 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-df3c5c66-c748-44c4-b111-f989cbbb75a3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b/ips" status: 200 len: 148 microversion: 2.1 time: 0.038567 Aug 31 01:25:39.685300 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 191/384] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Aug 31 01:25:39 2022] GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b/ips => generated 148 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:25:39.697442 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-a55cd61f-1c54-4478-b40a-13f3c5507081 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65d3391e-c61d-4019-baea-6bda7d3d4d7d"}} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:25:39.700249 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-a55cd61f-1c54-4478-b40a-13f3c5507081 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 082d7637-9b1c-469c-b688-c76ca61e9f6b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:39.707122 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a55cd61f-1c54-4478-b40a-13f3c5507081 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:39.707613 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a55cd61f-1c54-4478-b40a-13f3c5507081 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:39.708172 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a55cd61f-1c54-4478-b40a-13f3c5507081 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:39.709448 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a55cd61f-1c54-4478-b40a-13f3c5507081 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:39.710076 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a55cd61f-1c54-4478-b40a-13f3c5507081 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:39.710697 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a55cd61f-1c54-4478-b40a-13f3c5507081 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:39.796491 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.wsgi [None req-a55cd61f-1c54-4478-b40a-13f3c5507081 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] HTTP exception thrown: Invalid volume: volume 65d3391e-c61d-4019-baea-6bda7d3d4d7d is already attached to instances: 8ce564c8-7a17-4de1-96b9-3737fca73840 Aug 31 01:25:39.800157 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-a55cd61f-1c54-4478-b40a-13f3c5507081 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Request method failure captured: Aug 31 01:25:39.800157 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: request: POST /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b/os-volume_attachments HTTP/1.1 Aug 31 01:25:39.800157 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept: application/json Aug 31 01:25:39.800157 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept-Encoding: identity Aug 31 01:25:39.800157 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Connection: close Aug 31 01:25:39.800157 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Length: 74 Aug 31 01:25:39.800157 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Type: application/json Aug 31 01:25:39.800157 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Host: 10.222.0.20 Aug 31 01:25:39.800157 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Openstack-System-Scope: None Aug 31 01:25:39.800157 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: User-Agent: python-urllib3/1.26.12 Aug 31 01:25:39.800157 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Auth-Token: gAAAAABjDrfet2Sy4N8jKKJoN7i8trLl0KW7DYiW5JhaLj0L5xpx8IJJDKjwB1T51gnweVtzcKX7Vmb1NaayoFFPtTaITD4WxtfyhSUUM3_4_aZ5GptnzhJmrFo6ZwSNdxq7_gCewRQsJwS99WXQ3X8vSLGTrSznkbNFB8yNJvuQw_w6CXmffXc Aug 31 01:25:39.800157 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Id: None Aug 31 01:25:39.800157 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Name: None Aug 31 01:25:39.800157 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Identity-Status: Confirmed Aug 31 01:25:39.800157 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Is-Admin-Project: True Aug 31 01:25:39.800157 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Id: default Aug 31 01:25:39.800157 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Name: Default Aug 31 01:25:39.800157 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Id: 164da7d4776d4e9f8cf6497aa784d312 Aug 31 01:25:39.800157 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Name: tempest-AttachVolumeNegativeTest-1582720348 Aug 31 01:25:39.800157 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Role: member,reader Aug 31 01:25:39.800157 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Roles: member,reader Aug 31 01:25:39.805597 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/164da7d4776d4e9f8cf6497aa784d312"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_164da7d4776d4e9f8cf6497aa784d312", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/164da7d4776d4e9f8cf6497aa784d312"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/164da7d4776d4e9f8cf6497aa784d312"}]}] Aug 31 01:25:39.805597 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant: tempest-AttachVolumeNegativeTest-1582720348 Aug 31 01:25:39.805597 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Id: 164da7d4776d4e9f8cf6497aa784d312 Aug 31 01:25:39.805597 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1582720348 Aug 31 01:25:39.805597 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User: tempest-AttachVolumeNegativeTest-1582720348-project Aug 31 01:25:39.805597 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Id: default Aug 31 01:25:39.805597 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Name: Default Aug 31 01:25:39.805597 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Id: 52ed99737fd240789bb682fd9bf11be3 Aug 31 01:25:39.805597 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Name: tempest-AttachVolumeNegativeTest-1582720348-project Aug 31 01:25:39.805597 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Aug 31 01:25:39.805597 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: {"volumeAttachment": {"volumeId": "65d3391e-c61d-4019-baea-6bda7d3d4d7d"}} Aug 31 01:25:39.805597 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: method: > Aug 31 01:25:39.806518 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: exception: Invalid volume: volume 65d3391e-c61d-4019-baea-6bda7d3d4d7d is already attached to instances: 8ce564c8-7a17-4de1-96b9-3737fca73840 Aug 31 01:25:39.806518 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: action_args: {'server_id': '082d7637-9b1c-469c-b688-c76ca61e9f6b', 'body': {'volumeAttachment': {'volumeId': '65d3391e-c61d-4019-baea-6bda7d3d4d7d'}}} Aug 31 01:25:39.806518 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:25:39.806518 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:25:39.806518 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 01:25:39.806518 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 01:25:39.806518 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 01:25:39.806518 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 01:25:39.806518 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 01:25:39.806518 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 01:25:39.806518 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 31 01:25:39.806518 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 31 01:25:39.806518 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 31 01:25:39.806518 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 31 01:25:39.806518 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 65d3391e-c61d-4019-baea-6bda7d3d4d7d is already attached to instances: 8ce564c8-7a17-4de1-96b9-3737fca73840 Aug 31 01:25:39.806518 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:25:39.806518 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:25:39.806518 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:25:39.806518 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:25:39.808126 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:25:39.808126 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:25:39.808126 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:25:39.808126 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:25:39.808126 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:25:39.808126 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:25:39.808126 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 01:25:39.808126 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 01:25:39.808126 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 01:25:39.808126 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 01:25:39.808126 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 01:25:39.808126 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 01:25:39.808126 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 31 01:25:39.808126 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 01:25:39.808126 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 65d3391e-c61d-4019-baea-6bda7d3d4d7d is already attached to instances: 8ce564c8-7a17-4de1-96b9-3737fca73840 Aug 31 01:25:39.808126 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:25:39.808126 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:25:39.808126 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:25:39.808126 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:25:39.808126 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:25:39.810456 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:25:39.810456 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:25:39.810456 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:25:39.810456 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 65d3391e-c61d-4019-baea-6bda7d3d4d7d is already attached to instances: 8ce564c8-7a17-4de1-96b9-3737fca73840 Aug 31 01:25:39.810456 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:25:39.810456 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-a55cd61f-1c54-4478-b40a-13f3c5507081 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Returning 400 to user: Invalid volume: volume 65d3391e-c61d-4019-baea-6bda7d3d4d7d is already attached to instances: 8ce564c8-7a17-4de1-96b9-3737fca73840 {{(pid=121026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:25:39.810456 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-a55cd61f-1c54-4478-b40a-13f3c5507081 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "POST /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106922 Aug 31 01:25:39.810456 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 194/385] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 31 01:25:39 2022] POST /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 01:25:39.811581 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-c9923897-0ea5-468d-874b-005ea76755f7 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:39.811581 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-c9923897-0ea5-468d-874b-005ea76755f7 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 082d7637-9b1c-469c-b688-c76ca61e9f6b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:39.817709 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c9923897-0ea5-468d-874b-005ea76755f7 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:39.818210 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c9923897-0ea5-468d-874b-005ea76755f7 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:39.818668 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c9923897-0ea5-468d-874b-005ea76755f7 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:39.819474 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c9923897-0ea5-468d-874b-005ea76755f7 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:39.819848 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c9923897-0ea5-468d-874b-005ea76755f7 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:39.820264 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c9923897-0ea5-468d-874b-005ea76755f7 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:39.847235 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-c9923897-0ea5-468d-874b-005ea76755f7 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 082d7637-9b1c-469c-b688-c76ca61e9f6b] Going to try to terminate instance {{(pid=121025) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 01:25:40.136934 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-c9923897-0ea5-468d-874b-005ea76755f7 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "DELETE /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b" status: 204 len: 0 microversion: 2.1 time: 0.330622 Aug 31 01:25:40.137420 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 192/386] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 01:25:39 2022] DELETE /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 01:25:40.145637 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-11a2fe62-2fa4-4e38-987a-060f061b9f6d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:40.146250 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-11a2fe62-2fa4-4e38-987a-060f061b9f6d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 082d7637-9b1c-469c-b688-c76ca61e9f6b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:40.153153 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-11a2fe62-2fa4-4e38-987a-060f061b9f6d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:40.153639 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-11a2fe62-2fa4-4e38-987a-060f061b9f6d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:40.154074 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-11a2fe62-2fa4-4e38-987a-060f061b9f6d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:40.154773 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-11a2fe62-2fa4-4e38-987a-060f061b9f6d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:40.155238 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-11a2fe62-2fa4-4e38-987a-060f061b9f6d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:40.155644 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-11a2fe62-2fa4-4e38-987a-060f061b9f6d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:40.293991 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-11a2fe62-2fa4-4e38-987a-060f061b9f6d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:40.301767 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-11a2fe62-2fa4-4e38-987a-060f061b9f6d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b" status: 200 len: 1680 microversion: 2.1 time: 0.160000 Aug 31 01:25:40.302502 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 195/387] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:40 2022] GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:25:40.501348 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-029f5a3e-b5f0-4614-bb17-0515647943f6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:40.502074 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-029f5a3e-b5f0-4614-bb17-0515647943f6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:40.508777 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-029f5a3e-b5f0-4614-bb17-0515647943f6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:40.509266 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-029f5a3e-b5f0-4614-bb17-0515647943f6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:40.509704 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-029f5a3e-b5f0-4614-bb17-0515647943f6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:40.510398 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-029f5a3e-b5f0-4614-bb17-0515647943f6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:40.510894 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-029f5a3e-b5f0-4614-bb17-0515647943f6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:40.512240 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-029f5a3e-b5f0-4614-bb17-0515647943f6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:40.620458 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-0f7257ac-802b-494a-919e-efcf9deaa3f5 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:40.622422 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-0f7257ac-802b-494a-919e-efcf9deaa3f5 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:40.634239 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0f7257ac-802b-494a-919e-efcf9deaa3f5 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:40.634833 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0f7257ac-802b-494a-919e-efcf9deaa3f5 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:40.635344 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0f7257ac-802b-494a-919e-efcf9deaa3f5 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:40.636138 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0f7257ac-802b-494a-919e-efcf9deaa3f5 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:40.636680 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0f7257ac-802b-494a-919e-efcf9deaa3f5 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:40.637202 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0f7257ac-802b-494a-919e-efcf9deaa3f5 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:40.651837 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-029f5a3e-b5f0-4614-bb17-0515647943f6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:40.662590 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-029f5a3e-b5f0-4614-bb17-0515647943f6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:40.664974 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-029f5a3e-b5f0-4614-bb17-0515647943f6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:40.665868 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-029f5a3e-b5f0-4614-bb17-0515647943f6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1810 microversion: 2.20 time: 0.168755 Aug 31 01:25:40.666433 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 193/388] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:40 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:25:40.777683 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-0f7257ac-802b-494a-919e-efcf9deaa3f5 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:40.786213 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-0f7257ac-802b-494a-919e-efcf9deaa3f5 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1724 microversion: 2.1 time: 0.169790 Aug 31 01:25:40.786780 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 196/389] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:40 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:25:41.324323 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-cb895777-4d50-4632-b30f-9d6a46f80697 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:41.325249 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-cb895777-4d50-4632-b30f-9d6a46f80697 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 082d7637-9b1c-469c-b688-c76ca61e9f6b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:41.332176 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cb895777-4d50-4632-b30f-9d6a46f80697 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:41.332920 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cb895777-4d50-4632-b30f-9d6a46f80697 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:41.333347 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cb895777-4d50-4632-b30f-9d6a46f80697 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:41.334941 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cb895777-4d50-4632-b30f-9d6a46f80697 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:41.336161 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cb895777-4d50-4632-b30f-9d6a46f80697 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:41.336588 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cb895777-4d50-4632-b30f-9d6a46f80697 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:41.478652 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-cb895777-4d50-4632-b30f-9d6a46f80697 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:41.495658 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-cb895777-4d50-4632-b30f-9d6a46f80697 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b" status: 200 len: 1680 microversion: 2.1 time: 0.175914 Aug 31 01:25:41.496310 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 194/390] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:41 2022] GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b => generated 1680 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:25:41.694839 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-fd776657-ed77-4a65-8ad0-f6f563d14ce9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:41.696755 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-fd776657-ed77-4a65-8ad0-f6f563d14ce9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:41.702880 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fd776657-ed77-4a65-8ad0-f6f563d14ce9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:41.703620 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fd776657-ed77-4a65-8ad0-f6f563d14ce9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:41.704203 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fd776657-ed77-4a65-8ad0-f6f563d14ce9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:41.704944 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fd776657-ed77-4a65-8ad0-f6f563d14ce9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:41.705397 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fd776657-ed77-4a65-8ad0-f6f563d14ce9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:41.705927 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fd776657-ed77-4a65-8ad0-f6f563d14ce9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:41.808702 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-750bb860-3c99-4917-a72b-52e09c23ce2b tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:41.810293 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-750bb860-3c99-4917-a72b-52e09c23ce2b tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:41.818327 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-750bb860-3c99-4917-a72b-52e09c23ce2b tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:41.819210 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-750bb860-3c99-4917-a72b-52e09c23ce2b tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:41.820297 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-750bb860-3c99-4917-a72b-52e09c23ce2b tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:41.821689 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-750bb860-3c99-4917-a72b-52e09c23ce2b tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:41.822298 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-750bb860-3c99-4917-a72b-52e09c23ce2b tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:41.822877 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-750bb860-3c99-4917-a72b-52e09c23ce2b tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:41.881864 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-fd776657-ed77-4a65-8ad0-f6f563d14ce9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:41.892764 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-fd776657-ed77-4a65-8ad0-f6f563d14ce9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:41.895458 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-fd776657-ed77-4a65-8ad0-f6f563d14ce9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:41.897920 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-fd776657-ed77-4a65-8ad0-f6f563d14ce9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1810 microversion: 2.20 time: 0.211659 Aug 31 01:25:41.914632 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 197/391] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:41 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1810 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:25:42.034671 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-750bb860-3c99-4917-a72b-52e09c23ce2b tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:42.047009 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-750bb860-3c99-4917-a72b-52e09c23ce2b tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1724 microversion: 2.1 time: 0.243027 Aug 31 01:25:42.055096 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 195/392] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:41 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1724 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:25:42.518788 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-e029dc42-50a9-4146-a644-1321c92c7d7d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:42.519398 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-e029dc42-50a9-4146-a644-1321c92c7d7d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 082d7637-9b1c-469c-b688-c76ca61e9f6b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:42.526519 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e029dc42-50a9-4146-a644-1321c92c7d7d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:42.527183 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e029dc42-50a9-4146-a644-1321c92c7d7d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:42.527562 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e029dc42-50a9-4146-a644-1321c92c7d7d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:42.528254 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e029dc42-50a9-4146-a644-1321c92c7d7d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:42.528701 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e029dc42-50a9-4146-a644-1321c92c7d7d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:42.529352 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e029dc42-50a9-4146-a644-1321c92c7d7d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:42.668552 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-e029dc42-50a9-4146-a644-1321c92c7d7d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:42.676252 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-e029dc42-50a9-4146-a644-1321c92c7d7d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b" status: 200 len: 1680 microversion: 2.1 time: 0.161351 Aug 31 01:25:42.676835 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 198/393] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:42 2022] GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:25:42.924352 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-ae9da6ed-5ecb-4061-bec3-d051300fc761 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:42.940877 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-ae9da6ed-5ecb-4061-bec3-d051300fc761 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:42.940877 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ae9da6ed-5ecb-4061-bec3-d051300fc761 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:42.940877 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ae9da6ed-5ecb-4061-bec3-d051300fc761 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:42.940877 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ae9da6ed-5ecb-4061-bec3-d051300fc761 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:42.941283 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ae9da6ed-5ecb-4061-bec3-d051300fc761 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:42.941283 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ae9da6ed-5ecb-4061-bec3-d051300fc761 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:42.941283 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ae9da6ed-5ecb-4061-bec3-d051300fc761 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:43.062452 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-ae9da6ed-5ecb-4061-bec3-d051300fc761 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:43.067893 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-1e07e5fe-9f44-4bad-a6b3-9e3462240607 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:43.068626 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-1e07e5fe-9f44-4bad-a6b3-9e3462240607 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:43.071298 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-ae9da6ed-5ecb-4061-bec3-d051300fc761 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:43.072704 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-ae9da6ed-5ecb-4061-bec3-d051300fc761 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:43.073876 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-ae9da6ed-5ecb-4061-bec3-d051300fc761 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1810 microversion: 2.20 time: 0.153337 Aug 31 01:25:43.074435 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 196/394] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:42 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:25:43.074746 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1e07e5fe-9f44-4bad-a6b3-9e3462240607 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:43.075235 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1e07e5fe-9f44-4bad-a6b3-9e3462240607 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:43.075671 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1e07e5fe-9f44-4bad-a6b3-9e3462240607 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:43.076369 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1e07e5fe-9f44-4bad-a6b3-9e3462240607 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:43.076864 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1e07e5fe-9f44-4bad-a6b3-9e3462240607 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:43.077296 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1e07e5fe-9f44-4bad-a6b3-9e3462240607 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:43.454143 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-1e07e5fe-9f44-4bad-a6b3-9e3462240607 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:43.457657 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell1:SELECT=100 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:25:43.463152 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-1e07e5fe-9f44-4bad-a6b3-9e3462240607 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1724 microversion: 2.1 time: 0.399067 Aug 31 01:25:43.468709 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 199/395] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:43 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1724 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:25:43.698129 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-cedb94b1-ab1b-45eb-ab31-8222af99dc75 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:43.698743 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-cedb94b1-ab1b-45eb-ab31-8222af99dc75 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 082d7637-9b1c-469c-b688-c76ca61e9f6b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:43.705012 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cedb94b1-ab1b-45eb-ab31-8222af99dc75 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:43.705437 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cedb94b1-ab1b-45eb-ab31-8222af99dc75 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:43.705870 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cedb94b1-ab1b-45eb-ab31-8222af99dc75 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:43.706553 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cedb94b1-ab1b-45eb-ab31-8222af99dc75 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:43.707006 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cedb94b1-ab1b-45eb-ab31-8222af99dc75 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:43.707428 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cedb94b1-ab1b-45eb-ab31-8222af99dc75 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:43.837695 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-cedb94b1-ab1b-45eb-ab31-8222af99dc75 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:43.845507 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-cedb94b1-ab1b-45eb-ab31-8222af99dc75 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b" status: 200 len: 1680 microversion: 2.1 time: 0.151667 Aug 31 01:25:43.846058 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 197/396] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:43 2022] GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:25:44.099633 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-7806ba2e-f52d-475b-9fb2-7d5edef39fa6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:44.100227 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-7806ba2e-f52d-475b-9fb2-7d5edef39fa6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:44.107063 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7806ba2e-f52d-475b-9fb2-7d5edef39fa6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:44.107539 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7806ba2e-f52d-475b-9fb2-7d5edef39fa6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:44.107967 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7806ba2e-f52d-475b-9fb2-7d5edef39fa6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:44.108662 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7806ba2e-f52d-475b-9fb2-7d5edef39fa6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:44.114515 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7806ba2e-f52d-475b-9fb2-7d5edef39fa6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:44.114515 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7806ba2e-f52d-475b-9fb2-7d5edef39fa6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:44.240392 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-7806ba2e-f52d-475b-9fb2-7d5edef39fa6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:44.249453 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-7806ba2e-f52d-475b-9fb2-7d5edef39fa6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:44.250878 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-7806ba2e-f52d-475b-9fb2-7d5edef39fa6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:44.252027 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-7806ba2e-f52d-475b-9fb2-7d5edef39fa6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1810 microversion: 2.20 time: 0.156353 Aug 31 01:25:44.252581 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 200/397] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:44 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:25:44.485030 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-c81df5dc-6075-485a-ad90-8acefc26c5d5 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:44.486272 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-c81df5dc-6075-485a-ad90-8acefc26c5d5 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:44.493399 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c81df5dc-6075-485a-ad90-8acefc26c5d5 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:44.493913 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c81df5dc-6075-485a-ad90-8acefc26c5d5 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:44.494349 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c81df5dc-6075-485a-ad90-8acefc26c5d5 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:44.495041 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c81df5dc-6075-485a-ad90-8acefc26c5d5 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:44.495529 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c81df5dc-6075-485a-ad90-8acefc26c5d5 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:44.495950 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c81df5dc-6075-485a-ad90-8acefc26c5d5 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:44.528511 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-d23a3340-e4dd-4458-8269-b054674f5caa tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9118fa83-f3fd-4d9c-9325-562ffc2f04d3"}} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:25:44.530932 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-d23a3340-e4dd-4458-8269-b054674f5caa tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:44.537159 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d23a3340-e4dd-4458-8269-b054674f5caa tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:44.537726 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d23a3340-e4dd-4458-8269-b054674f5caa tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:44.538167 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d23a3340-e4dd-4458-8269-b054674f5caa tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:44.538887 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d23a3340-e4dd-4458-8269-b054674f5caa tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:44.539341 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d23a3340-e4dd-4458-8269-b054674f5caa tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:44.540254 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d23a3340-e4dd-4458-8269-b054674f5caa tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:44.624149 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-c81df5dc-6075-485a-ad90-8acefc26c5d5 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:44.632430 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-c81df5dc-6075-485a-ad90-8acefc26c5d5 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1724 microversion: 2.1 time: 0.151353 Aug 31 01:25:44.633013 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 198/398] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:44 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:25:44.866397 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-f1fc699b-3f81-4356-833a-cc905c15a3e9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:44.867014 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-f1fc699b-3f81-4356-833a-cc905c15a3e9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 082d7637-9b1c-469c-b688-c76ca61e9f6b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:44.873505 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f1fc699b-3f81-4356-833a-cc905c15a3e9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:44.874006 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f1fc699b-3f81-4356-833a-cc905c15a3e9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:44.874434 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f1fc699b-3f81-4356-833a-cc905c15a3e9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:44.875114 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f1fc699b-3f81-4356-833a-cc905c15a3e9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:44.875558 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f1fc699b-3f81-4356-833a-cc905c15a3e9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:44.875969 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f1fc699b-3f81-4356-833a-cc905c15a3e9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:45.061611 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-f1fc699b-3f81-4356-833a-cc905c15a3e9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:45.069468 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-f1fc699b-3f81-4356-833a-cc905c15a3e9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b" status: 200 len: 1680 microversion: 2.1 time: 0.207062 Aug 31 01:25:45.070036 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 199/399] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:44 2022] GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b => generated 1680 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:25:45.277461 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-5d01182a-436a-455a-8bc4-a1180498ba95 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:45.278078 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-5d01182a-436a-455a-8bc4-a1180498ba95 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:45.283927 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5d01182a-436a-455a-8bc4-a1180498ba95 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:45.286562 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5d01182a-436a-455a-8bc4-a1180498ba95 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:45.286562 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5d01182a-436a-455a-8bc4-a1180498ba95 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:45.286562 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5d01182a-436a-455a-8bc4-a1180498ba95 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:45.286562 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5d01182a-436a-455a-8bc4-a1180498ba95 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:45.287523 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5d01182a-436a-455a-8bc4-a1180498ba95 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:45.492389 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-5d01182a-436a-455a-8bc4-a1180498ba95 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:45.502163 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-5d01182a-436a-455a-8bc4-a1180498ba95 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:45.503754 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-5d01182a-436a-455a-8bc4-a1180498ba95 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:45.505358 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-5d01182a-436a-455a-8bc4-a1180498ba95 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1810 microversion: 2.20 time: 0.233627 Aug 31 01:25:45.516748 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 200/400] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:45 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1810 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 01:25:45.655526 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-bafd247c-4454-42f0-8401-7c4cc6ebd1f2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:45.656161 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-bafd247c-4454-42f0-8401-7c4cc6ebd1f2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:45.662331 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-bafd247c-4454-42f0-8401-7c4cc6ebd1f2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:45.662918 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-bafd247c-4454-42f0-8401-7c4cc6ebd1f2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:45.663420 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-bafd247c-4454-42f0-8401-7c4cc6ebd1f2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:45.664269 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-bafd247c-4454-42f0-8401-7c4cc6ebd1f2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:45.664991 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-bafd247c-4454-42f0-8401-7c4cc6ebd1f2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:45.665562 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-bafd247c-4454-42f0-8401-7c4cc6ebd1f2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:45.833687 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-d23a3340-e4dd-4458-8269-b054674f5caa tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "POST /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.308906 Aug 31 01:25:45.840330 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 201/401] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 31 01:25:44 2022] POST /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1/os-volume_attachments => generated 194 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:25:45.845949 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-bafd247c-4454-42f0-8401-7c4cc6ebd1f2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:45.861795 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-bafd247c-4454-42f0-8401-7c4cc6ebd1f2 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1724 microversion: 2.1 time: 0.211765 Aug 31 01:25:45.862961 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 201/402] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:45 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:25:46.094654 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-d782625c-a7ee-4e4f-8df2-fa42bf29460a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:46.095356 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-d782625c-a7ee-4e4f-8df2-fa42bf29460a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 082d7637-9b1c-469c-b688-c76ca61e9f6b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:46.101530 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d782625c-a7ee-4e4f-8df2-fa42bf29460a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:46.102016 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d782625c-a7ee-4e4f-8df2-fa42bf29460a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:46.102451 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d782625c-a7ee-4e4f-8df2-fa42bf29460a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:46.103148 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d782625c-a7ee-4e4f-8df2-fa42bf29460a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:46.103605 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d782625c-a7ee-4e4f-8df2-fa42bf29460a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:46.104028 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d782625c-a7ee-4e4f-8df2-fa42bf29460a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:46.253391 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-d782625c-a7ee-4e4f-8df2-fa42bf29460a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:46.254856 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-d782625c-a7ee-4e4f-8df2-fa42bf29460a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b" status: 200 len: 1680 microversion: 2.1 time: 0.164957 Aug 31 01:25:46.255434 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 202/403] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:46 2022] GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:25:46.531083 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-cfd5fe12-273b-407a-8b2f-cb6687213309 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:46.545308 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-cfd5fe12-273b-407a-8b2f-cb6687213309 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:46.557554 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cfd5fe12-273b-407a-8b2f-cb6687213309 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:46.558052 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cfd5fe12-273b-407a-8b2f-cb6687213309 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:46.558491 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cfd5fe12-273b-407a-8b2f-cb6687213309 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:46.562600 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cfd5fe12-273b-407a-8b2f-cb6687213309 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:46.563091 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cfd5fe12-273b-407a-8b2f-cb6687213309 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:46.564505 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cfd5fe12-273b-407a-8b2f-cb6687213309 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:46.613583 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [req-c6a340cf-3fd6-48d6-b742-43bb2fd2fa38 req-3ecb1a14-e15d-4e9d-9c79-c5a64b41eaed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "082d7637-9b1c-469c-b688-c76ca61e9f6b", "name": "network-vif-deleted", "tag": "3288282c-d42e-4903-85db-6161da718858"}]} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:25:46.628003 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-c6a340cf-3fd6-48d6-b742-43bb2fd2fa38 req-3ecb1a14-e15d-4e9d-9c79-c5a64b41eaed service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:46.628783 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-c6a340cf-3fd6-48d6-b742-43bb2fd2fa38 req-3ecb1a14-e15d-4e9d-9c79-c5a64b41eaed service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:46.629854 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-c6a340cf-3fd6-48d6-b742-43bb2fd2fa38 req-3ecb1a14-e15d-4e9d-9c79-c5a64b41eaed service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:46.644583 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.compute.server_external_events [req-c6a340cf-3fd6-48d6-b742-43bb2fd2fa38 req-3ecb1a14-e15d-4e9d-9c79-c5a64b41eaed service nova] Creating event network-vif-deleted:3288282c-d42e-4903-85db-6161da718858 for instance 082d7637-9b1c-469c-b688-c76ca61e9f6b on hv-cinder-85528 Aug 31 01:25:46.651423 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [req-c6a340cf-3fd6-48d6-b742-43bb2fd2fa38 req-3ecb1a14-e15d-4e9d-9c79-c5a64b41eaed service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041548 Aug 31 01:25:46.652504 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 203/404] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:25:46.752623 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-cfd5fe12-273b-407a-8b2f-cb6687213309 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:46.766269 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-cfd5fe12-273b-407a-8b2f-cb6687213309 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:46.767708 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-cfd5fe12-273b-407a-8b2f-cb6687213309 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:46.768998 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-cfd5fe12-273b-407a-8b2f-cb6687213309 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1810 microversion: 2.20 time: 0.243459 Aug 31 01:25:46.769925 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 202/405] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:46 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1810 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:25:46.887286 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-aff33fee-6288-4dae-9363-1e886d279e1c tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:46.887992 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-aff33fee-6288-4dae-9363-1e886d279e1c tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:46.896444 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-aff33fee-6288-4dae-9363-1e886d279e1c tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:46.897275 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-aff33fee-6288-4dae-9363-1e886d279e1c tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:46.897949 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-aff33fee-6288-4dae-9363-1e886d279e1c tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:46.900619 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-aff33fee-6288-4dae-9363-1e886d279e1c tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:46.901277 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-aff33fee-6288-4dae-9363-1e886d279e1c tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:46.901869 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-aff33fee-6288-4dae-9363-1e886d279e1c tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:47.079268 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-aff33fee-6288-4dae-9363-1e886d279e1c tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:47.088141 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-aff33fee-6288-4dae-9363-1e886d279e1c tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1724 microversion: 2.1 time: 0.207649 Aug 31 01:25:47.089146 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 204/406] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:46 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:25:47.279786 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-79a23313-2992-4824-8d46-9681ebe6aec6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:47.280651 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-79a23313-2992-4824-8d46-9681ebe6aec6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 082d7637-9b1c-469c-b688-c76ca61e9f6b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:47.287126 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-79a23313-2992-4824-8d46-9681ebe6aec6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:47.287539 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-79a23313-2992-4824-8d46-9681ebe6aec6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:47.287983 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-79a23313-2992-4824-8d46-9681ebe6aec6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:47.288673 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-79a23313-2992-4824-8d46-9681ebe6aec6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:47.289145 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-79a23313-2992-4824-8d46-9681ebe6aec6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:47.290280 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-79a23313-2992-4824-8d46-9681ebe6aec6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:47.330525 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-79a23313-2992-4824-8d46-9681ebe6aec6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:47.331323 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-79a23313-2992-4824-8d46-9681ebe6aec6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:47.331924 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-79a23313-2992-4824-8d46-9681ebe6aec6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:47.332380 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.objects.instance [None req-79a23313-2992-4824-8d46-9681ebe6aec6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lazy-loading 'fault' on Instance uuid 082d7637-9b1c-469c-b688-c76ca61e9f6b {{(pid=121025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:25:47.335682 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:25:47.384171 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-79a23313-2992-4824-8d46-9681ebe6aec6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:47.393617 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-79a23313-2992-4824-8d46-9681ebe6aec6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b" status: 200 len: 1331 microversion: 2.1 time: 0.117522 Aug 31 01:25:47.408244 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 203/407] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:47 2022] GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b => generated 1331 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:25:47.795688 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-3af189be-9499-4098-a92c-e1c5d972038d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:47.796512 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-3af189be-9499-4098-a92c-e1c5d972038d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:47.804219 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3af189be-9499-4098-a92c-e1c5d972038d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:47.804715 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3af189be-9499-4098-a92c-e1c5d972038d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:47.805708 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3af189be-9499-4098-a92c-e1c5d972038d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:47.806413 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3af189be-9499-4098-a92c-e1c5d972038d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:47.806868 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3af189be-9499-4098-a92c-e1c5d972038d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:47.807288 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3af189be-9499-4098-a92c-e1c5d972038d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:47.977819 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-3af189be-9499-4098-a92c-e1c5d972038d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:47.987371 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-3af189be-9499-4098-a92c-e1c5d972038d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:47.995309 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-3af189be-9499-4098-a92c-e1c5d972038d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:47.995309 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-3af189be-9499-4098-a92c-e1c5d972038d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1810 microversion: 2.20 time: 0.198864 Aug 31 01:25:47.995309 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 205/408] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:47 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1810 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:25:48.109076 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-fdc51418-ad91-457c-9e33-2a87b05d474e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:48.109683 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-fdc51418-ad91-457c-9e33-2a87b05d474e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:48.122239 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fdc51418-ad91-457c-9e33-2a87b05d474e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:48.123015 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fdc51418-ad91-457c-9e33-2a87b05d474e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:48.123456 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fdc51418-ad91-457c-9e33-2a87b05d474e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:48.124262 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fdc51418-ad91-457c-9e33-2a87b05d474e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:48.124700 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fdc51418-ad91-457c-9e33-2a87b05d474e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:48.125402 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fdc51418-ad91-457c-9e33-2a87b05d474e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:48.307148 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-fdc51418-ad91-457c-9e33-2a87b05d474e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:48.315506 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-fdc51418-ad91-457c-9e33-2a87b05d474e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1724 microversion: 2.1 time: 0.210565 Aug 31 01:25:48.316567 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 204/409] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:48 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:25:48.414843 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-01593fb6-bb3f-4546-88ec-537fb2e39f35 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:48.415785 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-01593fb6-bb3f-4546-88ec-537fb2e39f35 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 082d7637-9b1c-469c-b688-c76ca61e9f6b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:48.424621 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-01593fb6-bb3f-4546-88ec-537fb2e39f35 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:48.425313 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-01593fb6-bb3f-4546-88ec-537fb2e39f35 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:48.426068 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-01593fb6-bb3f-4546-88ec-537fb2e39f35 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:48.427055 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-01593fb6-bb3f-4546-88ec-537fb2e39f35 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:48.427685 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-01593fb6-bb3f-4546-88ec-537fb2e39f35 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:48.428606 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-01593fb6-bb3f-4546-88ec-537fb2e39f35 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:48.444678 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.wsgi [None req-01593fb6-bb3f-4546-88ec-537fb2e39f35 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] HTTP exception thrown: Instance 082d7637-9b1c-469c-b688-c76ca61e9f6b could not be found. Aug 31 01:25:48.446408 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-01593fb6-bb3f-4546-88ec-537fb2e39f35 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Request method failure captured: Aug 31 01:25:48.446408 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: request: GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b HTTP/1.1 Aug 31 01:25:48.446408 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept: application/json Aug 31 01:25:48.446408 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept-Encoding: identity Aug 31 01:25:48.446408 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Connection: close Aug 31 01:25:48.446408 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Length: 0 Aug 31 01:25:48.446408 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Type: application/json Aug 31 01:25:48.446408 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Host: 10.222.0.20 Aug 31 01:25:48.446408 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Openstack-System-Scope: None Aug 31 01:25:48.446408 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: User-Agent: python-urllib3/1.26.12 Aug 31 01:25:48.446408 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Auth-Token: gAAAAABjDrfet2Sy4N8jKKJoN7i8trLl0KW7DYiW5JhaLj0L5xpx8IJJDKjwB1T51gnweVtzcKX7Vmb1NaayoFFPtTaITD4WxtfyhSUUM3_4_aZ5GptnzhJmrFo6ZwSNdxq7_gCewRQsJwS99WXQ3X8vSLGTrSznkbNFB8yNJvuQw_w6CXmffXc Aug 31 01:25:48.446408 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Id: None Aug 31 01:25:48.446408 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Name: None Aug 31 01:25:48.446408 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Identity-Status: Confirmed Aug 31 01:25:48.446408 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Is-Admin-Project: True Aug 31 01:25:48.446408 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Id: default Aug 31 01:25:48.446408 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Name: Default Aug 31 01:25:48.446408 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Id: 164da7d4776d4e9f8cf6497aa784d312 Aug 31 01:25:48.446408 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Name: tempest-AttachVolumeNegativeTest-1582720348 Aug 31 01:25:48.446408 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Role: member,reader Aug 31 01:25:48.446408 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Roles: member,reader Aug 31 01:25:48.447934 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/164da7d4776d4e9f8cf6497aa784d312"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_164da7d4776d4e9f8cf6497aa784d312", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/164da7d4776d4e9f8cf6497aa784d312"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/164da7d4776d4e9f8cf6497aa784d312"}]}] Aug 31 01:25:48.447934 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant: tempest-AttachVolumeNegativeTest-1582720348 Aug 31 01:25:48.447934 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Id: 164da7d4776d4e9f8cf6497aa784d312 Aug 31 01:25:48.447934 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1582720348 Aug 31 01:25:48.447934 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User: tempest-AttachVolumeNegativeTest-1582720348-project Aug 31 01:25:48.447934 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Id: default Aug 31 01:25:48.447934 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Name: Default Aug 31 01:25:48.447934 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Id: 52ed99737fd240789bb682fd9bf11be3 Aug 31 01:25:48.447934 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Name: tempest-AttachVolumeNegativeTest-1582720348-project Aug 31 01:25:48.447934 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: method: > Aug 31 01:25:48.447934 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: exception: Instance 082d7637-9b1c-469c-b688-c76ca61e9f6b could not be found. Aug 31 01:25:48.447934 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: action_args: {'id': '082d7637-9b1c-469c-b688-c76ca61e9f6b'} Aug 31 01:25:48.448861 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:25:48.448861 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:25:48.448861 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:25:48.448861 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:25:48.448861 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:25:48.448861 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:25:48.448861 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:25:48.448861 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:25:48.448861 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:25:48.448861 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:25:48.448861 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 082d7637-9b1c-469c-b688-c76ca61e9f6b could not be found. Aug 31 01:25:48.448861 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:25:48.448861 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:25:48.448861 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:25:48.448861 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:25:48.448861 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:25:48.448861 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:25:48.448861 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:25:48.448861 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:25:48.448861 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:25:48.450274 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:25:48.450274 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:25:48.450274 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:25:48.450274 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:25:48.450274 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:25:48.450274 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:25:48.450274 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:25:48.450274 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 082d7637-9b1c-469c-b688-c76ca61e9f6b could not be found. Aug 31 01:25:48.450274 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:25:48.450274 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:25:48.450274 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:25:48.450274 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:25:48.450274 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:25:48.450274 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:25:48.450274 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:25:48.450274 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:25:48.450274 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 082d7637-9b1c-469c-b688-c76ca61e9f6b could not be found. Aug 31 01:25:48.450274 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:25:48.451419 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-01593fb6-bb3f-4546-88ec-537fb2e39f35 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Returning 404 to user: Instance 082d7637-9b1c-469c-b688-c76ca61e9f6b could not be found. {{(pid=121026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:25:48.451419 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-01593fb6-bb3f-4546-88ec-537fb2e39f35 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b" status: 404 len: 111 microversion: 2.1 time: 0.037443 Aug 31 01:25:48.452115 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 206/410] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:48 2022] GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:25:48.457075 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-1c9e9cc2-da60-4286-95d3-50e44233c411 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '.version_select at 0x7f1fe1ad09d0>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:48.612234 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-1c9e9cc2-da60-4286-95d3-50e44233c411 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1941655865" status: 202 len: 0 microversion: 2.1 time: 0.159184 Aug 31 01:25:48.612856 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 205/411] 10.222.0.20 () {58 vars in 1221 bytes} [Wed Aug 31 01:25:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1941655865 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 01:25:49.014896 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-ad246c85-fcc6-4b18-8118-c05b9c95611b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:49.015514 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-ad246c85-fcc6-4b18-8118-c05b9c95611b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:49.022426 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ad246c85-fcc6-4b18-8118-c05b9c95611b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:49.022919 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ad246c85-fcc6-4b18-8118-c05b9c95611b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:49.023654 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ad246c85-fcc6-4b18-8118-c05b9c95611b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:49.025074 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ad246c85-fcc6-4b18-8118-c05b9c95611b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:49.025701 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ad246c85-fcc6-4b18-8118-c05b9c95611b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:49.026283 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ad246c85-fcc6-4b18-8118-c05b9c95611b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:49.190959 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-ad246c85-fcc6-4b18-8118-c05b9c95611b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:49.200431 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-ad246c85-fcc6-4b18-8118-c05b9c95611b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:49.201899 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-ad246c85-fcc6-4b18-8118-c05b9c95611b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:49.203052 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-ad246c85-fcc6-4b18-8118-c05b9c95611b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1810 microversion: 2.20 time: 0.192607 Aug 31 01:25:49.203869 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 207/412] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:49 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1810 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:25:49.338232 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-ed22c801-9b8c-42c6-83b0-6330f667ff6c tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:49.338799 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-ed22c801-9b8c-42c6-83b0-6330f667ff6c tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:49.345587 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ed22c801-9b8c-42c6-83b0-6330f667ff6c tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:49.346073 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ed22c801-9b8c-42c6-83b0-6330f667ff6c tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:49.346511 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ed22c801-9b8c-42c6-83b0-6330f667ff6c tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:49.347213 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ed22c801-9b8c-42c6-83b0-6330f667ff6c tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:49.347670 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ed22c801-9b8c-42c6-83b0-6330f667ff6c tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:49.348096 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ed22c801-9b8c-42c6-83b0-6330f667ff6c tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:49.493430 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-ed22c801-9b8c-42c6-83b0-6330f667ff6c tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:49.503098 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-ed22c801-9b8c-42c6-83b0-6330f667ff6c tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1701 microversion: 2.1 time: 0.169272 Aug 31 01:25:49.503911 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 206/413] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:49 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1701 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:25:49.527081 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-3fe0c1b6-5225-421b-a257-ab6d662063e4 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:25:49.533293 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3fe0c1b6-5225-421b-a257-ab6d662063e4 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:49.533777 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3fe0c1b6-5225-421b-a257-ab6d662063e4 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:49.534213 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3fe0c1b6-5225-421b-a257-ab6d662063e4 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:49.543409 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-b3dbf07d-ca4c-4018-b40e-dcdba02b1875 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:49.549106 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-b3dbf07d-ca4c-4018-b40e-dcdba02b1875 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 8ce564c8-7a17-4de1-96b9-3737fca73840] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:49.550121 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b3dbf07d-ca4c-4018-b40e-dcdba02b1875 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:49.550608 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b3dbf07d-ca4c-4018-b40e-dcdba02b1875 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:49.551040 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b3dbf07d-ca4c-4018-b40e-dcdba02b1875 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:49.551733 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b3dbf07d-ca4c-4018-b40e-dcdba02b1875 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:49.552189 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b3dbf07d-ca4c-4018-b40e-dcdba02b1875 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:49.552613 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b3dbf07d-ca4c-4018-b40e-dcdba02b1875 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:49.594652 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-3fe0c1b6-5225-421b-a257-ab6d662063e4 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Going to try to start instance {{(pid=121026) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 01:25:49.676620 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.objects.instance [None req-b3dbf07d-ca4c-4018-b40e-dcdba02b1875 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lazy-loading 'services' on Instance uuid 8ce564c8-7a17-4de1-96b9-3737fca73840 {{(pid=121025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:25:49.772902 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-3fe0c1b6-5225-421b-a257-ab6d662063e4 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "POST /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b/action" status: 202 len: 0 microversion: 2.1 time: 0.249583 Aug 31 01:25:49.780883 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 208/414] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 31 01:25:49 2022] POST /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 01:25:49.781963 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-aa9b5cd2-0ce6-4e23-986e-ed7aea022bce tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:49.782664 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-aa9b5cd2-0ce6-4e23-986e-ed7aea022bce tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:49.788834 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-aa9b5cd2-0ce6-4e23-986e-ed7aea022bce tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:49.789959 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-aa9b5cd2-0ce6-4e23-986e-ed7aea022bce tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:49.790404 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-aa9b5cd2-0ce6-4e23-986e-ed7aea022bce tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:49.791164 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-aa9b5cd2-0ce6-4e23-986e-ed7aea022bce tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:49.791615 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-aa9b5cd2-0ce6-4e23-986e-ed7aea022bce tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:49.792092 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-aa9b5cd2-0ce6-4e23-986e-ed7aea022bce tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:49.915654 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-b3dbf07d-ca4c-4018-b40e-dcdba02b1875 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840/os-volume_attachments/65d3391e-c61d-4019-baea-6bda7d3d4d7d" status: 202 len: 0 microversion: 2.1 time: 0.375500 Aug 31 01:25:49.916539 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 207/415] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 31 01:25:49 2022] DELETE /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840/os-volume_attachments/65d3391e-c61d-4019-baea-6bda7d3d4d7d => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 01:25:49.926238 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-aa9b5cd2-0ce6-4e23-986e-ed7aea022bce tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:49.928521 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-ba25e779-8084-416f-8feb-91e29d4914cc tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:49.932534 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-ba25e779-8084-416f-8feb-91e29d4914cc tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 8ce564c8-7a17-4de1-96b9-3737fca73840] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:49.937103 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-aa9b5cd2-0ce6-4e23-986e-ed7aea022bce tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1710 microversion: 2.1 time: 0.159199 Aug 31 01:25:49.938176 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 209/416] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:49 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1710 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:25:49.939047 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ba25e779-8084-416f-8feb-91e29d4914cc tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:49.939641 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ba25e779-8084-416f-8feb-91e29d4914cc tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:49.940006 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ba25e779-8084-416f-8feb-91e29d4914cc tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:49.940694 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ba25e779-8084-416f-8feb-91e29d4914cc tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:49.941172 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ba25e779-8084-416f-8feb-91e29d4914cc tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:49.941585 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ba25e779-8084-416f-8feb-91e29d4914cc tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:49.973779 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-ba25e779-8084-416f-8feb-91e29d4914cc tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051406 Aug 31 01:25:49.974346 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 208/417] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 01:25:49 2022] GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:25:50.227350 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-ef90bd33-3c5f-4d32-ab0d-6e0fc1771de2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:50.227958 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-ef90bd33-3c5f-4d32-ab0d-6e0fc1771de2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:50.234412 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ef90bd33-3c5f-4d32-ab0d-6e0fc1771de2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:50.235173 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ef90bd33-3c5f-4d32-ab0d-6e0fc1771de2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:50.235638 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ef90bd33-3c5f-4d32-ab0d-6e0fc1771de2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:50.236312 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ef90bd33-3c5f-4d32-ab0d-6e0fc1771de2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:50.236774 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ef90bd33-3c5f-4d32-ab0d-6e0fc1771de2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:50.237189 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ef90bd33-3c5f-4d32-ab0d-6e0fc1771de2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:50.365963 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-ef90bd33-3c5f-4d32-ab0d-6e0fc1771de2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:50.374467 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-ef90bd33-3c5f-4d32-ab0d-6e0fc1771de2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:50.375900 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-ef90bd33-3c5f-4d32-ab0d-6e0fc1771de2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:50.377085 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-ef90bd33-3c5f-4d32-ab0d-6e0fc1771de2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1810 microversion: 2.20 time: 0.154393 Aug 31 01:25:50.377649 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 210/418] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:50 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:25:50.958326 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-cb3902ff-2206-40b6-953e-1f4606fb1be6 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:50.958953 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-cb3902ff-2206-40b6-953e-1f4606fb1be6 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:50.965804 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cb3902ff-2206-40b6-953e-1f4606fb1be6 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:50.966286 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cb3902ff-2206-40b6-953e-1f4606fb1be6 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:50.966711 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cb3902ff-2206-40b6-953e-1f4606fb1be6 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:50.967389 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cb3902ff-2206-40b6-953e-1f4606fb1be6 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:50.967834 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cb3902ff-2206-40b6-953e-1f4606fb1be6 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:50.968891 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cb3902ff-2206-40b6-953e-1f4606fb1be6 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:50.986819 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-7cebd9af-5d7a-481d-ab34-31e7abfa929e tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:50.989215 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-7cebd9af-5d7a-481d-ab34-31e7abfa929e tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 8ce564c8-7a17-4de1-96b9-3737fca73840] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:50.995654 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7cebd9af-5d7a-481d-ab34-31e7abfa929e tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:50.996144 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7cebd9af-5d7a-481d-ab34-31e7abfa929e tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:50.996580 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7cebd9af-5d7a-481d-ab34-31e7abfa929e tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:50.997338 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7cebd9af-5d7a-481d-ab34-31e7abfa929e tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:50.997792 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7cebd9af-5d7a-481d-ab34-31e7abfa929e tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:50.998242 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7cebd9af-5d7a-481d-ab34-31e7abfa929e tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:51.029349 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-7cebd9af-5d7a-481d-ab34-31e7abfa929e tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046306 Aug 31 01:25:51.032870 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 211/419] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 01:25:50 2022] GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:25:51.103837 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-cb3902ff-2206-40b6-953e-1f4606fb1be6 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:51.112333 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-cb3902ff-2206-40b6-953e-1f4606fb1be6 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1710 microversion: 2.1 time: 0.157811 Aug 31 01:25:51.112934 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 209/420] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:50 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1710 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:25:51.400586 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-644fc0f3-a958-4f6f-834a-df6058028ced tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:51.401291 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-644fc0f3-a958-4f6f-834a-df6058028ced tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:51.407620 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-644fc0f3-a958-4f6f-834a-df6058028ced tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:51.408103 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-644fc0f3-a958-4f6f-834a-df6058028ced tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:51.408538 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-644fc0f3-a958-4f6f-834a-df6058028ced tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:51.409261 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-644fc0f3-a958-4f6f-834a-df6058028ced tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:51.409714 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-644fc0f3-a958-4f6f-834a-df6058028ced tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:51.410136 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-644fc0f3-a958-4f6f-834a-df6058028ced tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:51.544532 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-644fc0f3-a958-4f6f-834a-df6058028ced tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:51.553171 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-644fc0f3-a958-4f6f-834a-df6058028ced tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:51.555150 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-644fc0f3-a958-4f6f-834a-df6058028ced tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:51.556371 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-644fc0f3-a958-4f6f-834a-df6058028ced tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1810 microversion: 2.20 time: 0.160329 Aug 31 01:25:51.557178 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 212/421] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:51 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:25:52.041711 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-fb90034e-78de-4dc2-a98f-e3f4b23d453b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:52.043997 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-fb90034e-78de-4dc2-a98f-e3f4b23d453b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 8ce564c8-7a17-4de1-96b9-3737fca73840] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:52.050438 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fb90034e-78de-4dc2-a98f-e3f4b23d453b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:52.050919 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fb90034e-78de-4dc2-a98f-e3f4b23d453b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:52.051391 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fb90034e-78de-4dc2-a98f-e3f4b23d453b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:52.052087 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fb90034e-78de-4dc2-a98f-e3f4b23d453b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:52.052537 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fb90034e-78de-4dc2-a98f-e3f4b23d453b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:52.052997 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fb90034e-78de-4dc2-a98f-e3f4b23d453b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:52.083115 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-fb90034e-78de-4dc2-a98f-e3f4b23d453b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045423 Aug 31 01:25:52.083662 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 210/422] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 01:25:52 2022] GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:25:52.132692 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-4def2259-f9da-4e1c-a38c-9587760a58d7 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:52.133922 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-4def2259-f9da-4e1c-a38c-9587760a58d7 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:52.139891 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4def2259-f9da-4e1c-a38c-9587760a58d7 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:52.140446 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4def2259-f9da-4e1c-a38c-9587760a58d7 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:52.140998 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4def2259-f9da-4e1c-a38c-9587760a58d7 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:52.141689 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4def2259-f9da-4e1c-a38c-9587760a58d7 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:52.142141 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4def2259-f9da-4e1c-a38c-9587760a58d7 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:52.142561 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4def2259-f9da-4e1c-a38c-9587760a58d7 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:52.270545 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-4def2259-f9da-4e1c-a38c-9587760a58d7 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:52.279050 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-4def2259-f9da-4e1c-a38c-9587760a58d7 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1710 microversion: 2.1 time: 0.150224 Aug 31 01:25:52.279614 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 213/423] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:52 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1710 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:25:52.587721 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-f2a9d323-1489-4ff4-a506-1faaabf11ac7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:52.588209 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-f2a9d323-1489-4ff4-a506-1faaabf11ac7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:52.594515 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f2a9d323-1489-4ff4-a506-1faaabf11ac7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:52.594993 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f2a9d323-1489-4ff4-a506-1faaabf11ac7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:52.595423 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f2a9d323-1489-4ff4-a506-1faaabf11ac7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:52.596107 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f2a9d323-1489-4ff4-a506-1faaabf11ac7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:52.596557 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f2a9d323-1489-4ff4-a506-1faaabf11ac7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:52.596999 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f2a9d323-1489-4ff4-a506-1faaabf11ac7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:52.725907 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-f2a9d323-1489-4ff4-a506-1faaabf11ac7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:52.735382 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-f2a9d323-1489-4ff4-a506-1faaabf11ac7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:52.736841 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-f2a9d323-1489-4ff4-a506-1faaabf11ac7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:52.738004 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-f2a9d323-1489-4ff4-a506-1faaabf11ac7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1810 microversion: 2.20 time: 0.154327 Aug 31 01:25:52.738563 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 211/424] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:52 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:25:53.096392 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-cfbd8106-af77-49f4-aba4-47e7238d9994 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:53.098780 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-cfbd8106-af77-49f4-aba4-47e7238d9994 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 8ce564c8-7a17-4de1-96b9-3737fca73840] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:53.105192 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cfbd8106-af77-49f4-aba4-47e7238d9994 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:53.105675 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cfbd8106-af77-49f4-aba4-47e7238d9994 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:53.106124 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cfbd8106-af77-49f4-aba4-47e7238d9994 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:53.106794 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cfbd8106-af77-49f4-aba4-47e7238d9994 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:53.107247 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cfbd8106-af77-49f4-aba4-47e7238d9994 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:53.107670 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cfbd8106-af77-49f4-aba4-47e7238d9994 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:53.139214 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-cfbd8106-af77-49f4-aba4-47e7238d9994 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046761 Aug 31 01:25:53.139782 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 214/425] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 01:25:53 2022] GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:25:53.299332 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-9fc60d8c-eecd-4ea3-b07c-fd3c425fdcd0 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:53.299962 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-9fc60d8c-eecd-4ea3-b07c-fd3c425fdcd0 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:53.307242 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9fc60d8c-eecd-4ea3-b07c-fd3c425fdcd0 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:53.307718 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9fc60d8c-eecd-4ea3-b07c-fd3c425fdcd0 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:53.308144 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9fc60d8c-eecd-4ea3-b07c-fd3c425fdcd0 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:53.308848 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9fc60d8c-eecd-4ea3-b07c-fd3c425fdcd0 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:53.309314 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9fc60d8c-eecd-4ea3-b07c-fd3c425fdcd0 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:53.309706 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9fc60d8c-eecd-4ea3-b07c-fd3c425fdcd0 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:53.443256 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-9fc60d8c-eecd-4ea3-b07c-fd3c425fdcd0 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:53.451419 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-9fc60d8c-eecd-4ea3-b07c-fd3c425fdcd0 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1714 microversion: 2.1 time: 0.155861 Aug 31 01:25:53.451982 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 212/426] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:53 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1714 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:25:53.643460 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [req-bcaf7d41-f675-4ccd-a38a-33af1deec9a9 req-dd284031-f6cb-4123-96a0-5880c8a2b611 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12814f73-696a-4dc2-9182-7779bfe90ad5", "name": "network-vif-plugged", "status": "completed", "tag": "dc60a507-f9d6-4b68-ae6c-65c2cfafb12c"}]} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:25:53.653189 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-bcaf7d41-f675-4ccd-a38a-33af1deec9a9 req-dd284031-f6cb-4123-96a0-5880c8a2b611 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:53.653698 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-bcaf7d41-f675-4ccd-a38a-33af1deec9a9 req-dd284031-f6cb-4123-96a0-5880c8a2b611 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:53.654122 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-bcaf7d41-f675-4ccd-a38a-33af1deec9a9 req-dd284031-f6cb-4123-96a0-5880c8a2b611 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:53.665762 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.compute.server_external_events [req-bcaf7d41-f675-4ccd-a38a-33af1deec9a9 req-dd284031-f6cb-4123-96a0-5880c8a2b611 service nova] Creating event network-vif-plugged:dc60a507-f9d6-4b68-ae6c-65c2cfafb12c for instance 12814f73-696a-4dc2-9182-7779bfe90ad5 on hv-cinder-85528 Aug 31 01:25:53.670626 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [req-bcaf7d41-f675-4ccd-a38a-33af1deec9a9 req-dd284031-f6cb-4123-96a0-5880c8a2b611 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030843 Aug 31 01:25:53.671538 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 215/427] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:25:53.761320 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-6f34426c-6cc0-4b99-8e7d-6a77861d900f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:53.762039 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-6f34426c-6cc0-4b99-8e7d-6a77861d900f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:53.768166 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6f34426c-6cc0-4b99-8e7d-6a77861d900f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:53.768644 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6f34426c-6cc0-4b99-8e7d-6a77861d900f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:53.769106 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6f34426c-6cc0-4b99-8e7d-6a77861d900f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:53.769790 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6f34426c-6cc0-4b99-8e7d-6a77861d900f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:53.770302 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6f34426c-6cc0-4b99-8e7d-6a77861d900f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:53.770718 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6f34426c-6cc0-4b99-8e7d-6a77861d900f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:53.897459 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-6f34426c-6cc0-4b99-8e7d-6a77861d900f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:53.906672 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-6f34426c-6cc0-4b99-8e7d-6a77861d900f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:53.908136 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-6f34426c-6cc0-4b99-8e7d-6a77861d900f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:53.909319 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-6f34426c-6cc0-4b99-8e7d-6a77861d900f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1810 microversion: 2.20 time: 0.151941 Aug 31 01:25:53.909877 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 213/428] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:53 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:25:54.153176 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-4da92b51-5a72-43c3-89e1-605a8a1b0ef0 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:54.155319 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-4da92b51-5a72-43c3-89e1-605a8a1b0ef0 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 8ce564c8-7a17-4de1-96b9-3737fca73840] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:54.161535 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4da92b51-5a72-43c3-89e1-605a8a1b0ef0 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:54.162012 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4da92b51-5a72-43c3-89e1-605a8a1b0ef0 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:54.162446 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4da92b51-5a72-43c3-89e1-605a8a1b0ef0 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:54.163132 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4da92b51-5a72-43c3-89e1-605a8a1b0ef0 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:54.163583 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4da92b51-5a72-43c3-89e1-605a8a1b0ef0 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:54.164048 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4da92b51-5a72-43c3-89e1-605a8a1b0ef0 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:54.168343 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:25:54.194458 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-4da92b51-5a72-43c3-89e1-605a8a1b0ef0 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046896 Aug 31 01:25:54.195021 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 216/429] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 01:25:54 2022] GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:25:54.534167 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-1323ca39-f180-4ece-b073-8c56a1bcb853 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:25:54.536469 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-1323ca39-f180-4ece-b073-8c56a1bcb853 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:54.542929 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1323ca39-f180-4ece-b073-8c56a1bcb853 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:54.543414 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1323ca39-f180-4ece-b073-8c56a1bcb853 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:54.543868 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1323ca39-f180-4ece-b073-8c56a1bcb853 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:54.544558 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1323ca39-f180-4ece-b073-8c56a1bcb853 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:54.545046 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1323ca39-f180-4ece-b073-8c56a1bcb853 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:54.545523 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1323ca39-f180-4ece-b073-8c56a1bcb853 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:54.573444 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.objects.instance [None req-1323ca39-f180-4ece-b073-8c56a1bcb853 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lazy-loading 'flavor' on Instance uuid 380077d1-0ed7-47ac-9e19-5425164e6da1 {{(pid=121025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:25:54.911218 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-1323ca39-f180-4ece-b073-8c56a1bcb853 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "POST /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1/action" status: 200 len: 32 microversion: 2.1 time: 0.380961 Aug 31 01:25:54.911826 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 214/430] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 31 01:25:54 2022] POST /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1/action => generated 32 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 01:25:54.921515 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-0f9cc798-a56c-46f9-8b7c-7f0b42514a34 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:54.922107 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-0f9cc798-a56c-46f9-8b7c-7f0b42514a34 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:54.928319 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0f9cc798-a56c-46f9-8b7c-7f0b42514a34 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:54.928817 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0f9cc798-a56c-46f9-8b7c-7f0b42514a34 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:54.929243 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0f9cc798-a56c-46f9-8b7c-7f0b42514a34 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:54.929969 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0f9cc798-a56c-46f9-8b7c-7f0b42514a34 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:54.930415 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0f9cc798-a56c-46f9-8b7c-7f0b42514a34 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:54.930829 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0f9cc798-a56c-46f9-8b7c-7f0b42514a34 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:54.932811 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-b1742976-2687-45b3-b189-526bfe2d9c79 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:54.933510 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-b1742976-2687-45b3-b189-526bfe2d9c79 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:54.939555 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b1742976-2687-45b3-b189-526bfe2d9c79 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:54.942575 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b1742976-2687-45b3-b189-526bfe2d9c79 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:54.942575 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b1742976-2687-45b3-b189-526bfe2d9c79 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:54.942575 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b1742976-2687-45b3-b189-526bfe2d9c79 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:54.942575 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b1742976-2687-45b3-b189-526bfe2d9c79 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:54.942924 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b1742976-2687-45b3-b189-526bfe2d9c79 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:55.141832 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-0f9cc798-a56c-46f9-8b7c-7f0b42514a34 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:55.145691 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-b1742976-2687-45b3-b189-526bfe2d9c79 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:55.155978 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-b1742976-2687-45b3-b189-526bfe2d9c79 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:55.156329 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-0f9cc798-a56c-46f9-8b7c-7f0b42514a34 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1737 microversion: 2.1 time: 0.238799 Aug 31 01:25:55.157437 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-b1742976-2687-45b3-b189-526bfe2d9c79 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:55.158270 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 217/431] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:54 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1737 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:25:55.158622 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-b1742976-2687-45b3-b189-526bfe2d9c79 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1810 microversion: 2.20 time: 0.230016 Aug 31 01:25:55.159339 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 215/432] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:54 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1810 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 01:25:55.207463 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-56799948-6f74-44a8-ae3d-2cde6b6dbb21 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:55.209775 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-56799948-6f74-44a8-ae3d-2cde6b6dbb21 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 8ce564c8-7a17-4de1-96b9-3737fca73840] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:55.215709 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-56799948-6f74-44a8-ae3d-2cde6b6dbb21 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:55.216190 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-56799948-6f74-44a8-ae3d-2cde6b6dbb21 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:55.216621 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-56799948-6f74-44a8-ae3d-2cde6b6dbb21 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:55.217348 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-56799948-6f74-44a8-ae3d-2cde6b6dbb21 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:55.217797 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-56799948-6f74-44a8-ae3d-2cde6b6dbb21 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:55.218213 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-56799948-6f74-44a8-ae3d-2cde6b6dbb21 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:55.252675 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-56799948-6f74-44a8-ae3d-2cde6b6dbb21 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049348 Aug 31 01:25:55.253262 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 218/433] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 01:25:55 2022] GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:25:56.178161 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-cb163880-a2e2-4cb5-b014-b16a25cdce87 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:56.178761 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-cb163880-a2e2-4cb5-b014-b16a25cdce87 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:56.183604 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-397a8512-ab74-4d2d-9c1f-6aacd0ce5984 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:56.184276 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-397a8512-ab74-4d2d-9c1f-6aacd0ce5984 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:56.186154 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cb163880-a2e2-4cb5-b014-b16a25cdce87 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:56.186635 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cb163880-a2e2-4cb5-b014-b16a25cdce87 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:56.187064 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cb163880-a2e2-4cb5-b014-b16a25cdce87 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:56.187756 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cb163880-a2e2-4cb5-b014-b16a25cdce87 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:56.188205 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cb163880-a2e2-4cb5-b014-b16a25cdce87 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:56.188619 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cb163880-a2e2-4cb5-b014-b16a25cdce87 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:56.191286 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-397a8512-ab74-4d2d-9c1f-6aacd0ce5984 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:56.191777 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-397a8512-ab74-4d2d-9c1f-6aacd0ce5984 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:56.192210 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-397a8512-ab74-4d2d-9c1f-6aacd0ce5984 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:56.193024 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-397a8512-ab74-4d2d-9c1f-6aacd0ce5984 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:56.193376 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-397a8512-ab74-4d2d-9c1f-6aacd0ce5984 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:56.193804 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-397a8512-ab74-4d2d-9c1f-6aacd0ce5984 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:56.377748 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-cb163880-a2e2-4cb5-b014-b16a25cdce87 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:56.387457 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-cb163880-a2e2-4cb5-b014-b16a25cdce87 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1737 microversion: 2.1 time: 0.213044 Aug 31 01:25:56.388019 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 216/434] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:56 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:25:56.395432 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-397a8512-ab74-4d2d-9c1f-6aacd0ce5984 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:56.395607 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-8e389549-185a-4acc-bf11-61c32d7d740b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:56.395607 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-8e389549-185a-4acc-bf11-61c32d7d740b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 8ce564c8-7a17-4de1-96b9-3737fca73840] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:56.399766 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-397a8512-ab74-4d2d-9c1f-6aacd0ce5984 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:56.401465 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-397a8512-ab74-4d2d-9c1f-6aacd0ce5984 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:56.405299 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8e389549-185a-4acc-bf11-61c32d7d740b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:56.405299 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8e389549-185a-4acc-bf11-61c32d7d740b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:56.405299 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8e389549-185a-4acc-bf11-61c32d7d740b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:56.405712 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-397a8512-ab74-4d2d-9c1f-6aacd0ce5984 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1810 microversion: 2.20 time: 0.223558 Aug 31 01:25:56.405712 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 219/435] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:56 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1810 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 01:25:56.405902 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8e389549-185a-4acc-bf11-61c32d7d740b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:56.405902 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8e389549-185a-4acc-bf11-61c32d7d740b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:56.405902 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8e389549-185a-4acc-bf11-61c32d7d740b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:56.433972 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-8e389549-185a-4acc-bf11-61c32d7d740b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044838 Aug 31 01:25:56.434500 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 217/436] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 01:25:56 2022] GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 01:25:56.500629 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-66a03cd4-6103-4a1e-8d24-90eac117699a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:56.501281 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-66a03cd4-6103-4a1e-8d24-90eac117699a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 8ce564c8-7a17-4de1-96b9-3737fca73840] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:56.507233 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-66a03cd4-6103-4a1e-8d24-90eac117699a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:56.508247 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-66a03cd4-6103-4a1e-8d24-90eac117699a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:56.508706 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-66a03cd4-6103-4a1e-8d24-90eac117699a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:56.509412 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-66a03cd4-6103-4a1e-8d24-90eac117699a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:56.509864 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-66a03cd4-6103-4a1e-8d24-90eac117699a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:56.510291 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-66a03cd4-6103-4a1e-8d24-90eac117699a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:56.535510 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-66a03cd4-6103-4a1e-8d24-90eac117699a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 8ce564c8-7a17-4de1-96b9-3737fca73840] Going to try to terminate instance {{(pid=121026) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 01:25:56.924906 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-66a03cd4-6103-4a1e-8d24-90eac117699a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840" status: 204 len: 0 microversion: 2.1 time: 0.428067 Aug 31 01:25:56.925502 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 220/437] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 01:25:56 2022] DELETE /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 01:25:56.934313 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-56958182-c704-47b7-b12f-6ca1f9cc7432 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:56.934959 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-56958182-c704-47b7-b12f-6ca1f9cc7432 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 8ce564c8-7a17-4de1-96b9-3737fca73840] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:56.940891 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-56958182-c704-47b7-b12f-6ca1f9cc7432 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:56.941373 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-56958182-c704-47b7-b12f-6ca1f9cc7432 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:56.941806 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-56958182-c704-47b7-b12f-6ca1f9cc7432 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:56.942495 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-56958182-c704-47b7-b12f-6ca1f9cc7432 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:56.942947 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-56958182-c704-47b7-b12f-6ca1f9cc7432 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:56.943369 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-56958182-c704-47b7-b12f-6ca1f9cc7432 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:56.960267 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:25:57.076221 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-56958182-c704-47b7-b12f-6ca1f9cc7432 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:57.084116 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-56958182-c704-47b7-b12f-6ca1f9cc7432 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840" status: 200 len: 1677 microversion: 2.1 time: 0.154338 Aug 31 01:25:57.084678 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 218/438] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:56 2022] GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:25:57.409471 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-796cdfae-145b-4311-9507-7bcd05640707 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:57.410082 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-796cdfae-145b-4311-9507-7bcd05640707 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:57.416511 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-796cdfae-145b-4311-9507-7bcd05640707 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:57.417019 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-796cdfae-145b-4311-9507-7bcd05640707 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:57.417448 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-796cdfae-145b-4311-9507-7bcd05640707 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:57.418124 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-796cdfae-145b-4311-9507-7bcd05640707 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:57.418569 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-796cdfae-145b-4311-9507-7bcd05640707 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:57.418982 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-796cdfae-145b-4311-9507-7bcd05640707 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:57.426112 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-5f9dd4e4-b844-4b3f-88cb-fbf087766106 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:57.426720 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-5f9dd4e4-b844-4b3f-88cb-fbf087766106 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:57.434216 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5f9dd4e4-b844-4b3f-88cb-fbf087766106 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:57.434702 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5f9dd4e4-b844-4b3f-88cb-fbf087766106 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:57.435195 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5f9dd4e4-b844-4b3f-88cb-fbf087766106 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:57.435887 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5f9dd4e4-b844-4b3f-88cb-fbf087766106 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:57.436339 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5f9dd4e4-b844-4b3f-88cb-fbf087766106 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:57.436787 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5f9dd4e4-b844-4b3f-88cb-fbf087766106 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:57.599354 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-796cdfae-145b-4311-9507-7bcd05640707 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:57.607863 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-796cdfae-145b-4311-9507-7bcd05640707 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1737 microversion: 2.1 time: 0.202624 Aug 31 01:25:57.609328 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 221/439] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:57 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1737 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:25:57.622783 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-5f9dd4e4-b844-4b3f-88cb-fbf087766106 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:57.631240 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-5f9dd4e4-b844-4b3f-88cb-fbf087766106 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:57.633287 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-5f9dd4e4-b844-4b3f-88cb-fbf087766106 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:57.634434 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-5f9dd4e4-b844-4b3f-88cb-fbf087766106 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1810 microversion: 2.20 time: 0.212138 Aug 31 01:25:57.634986 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 219/440] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:57 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1810 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 01:25:58.105944 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-33a87b37-cc32-484d-a394-c461cb192098 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:58.106557 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-33a87b37-cc32-484d-a394-c461cb192098 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 8ce564c8-7a17-4de1-96b9-3737fca73840] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:58.112485 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-33a87b37-cc32-484d-a394-c461cb192098 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:58.112995 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-33a87b37-cc32-484d-a394-c461cb192098 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:58.113434 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-33a87b37-cc32-484d-a394-c461cb192098 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:58.114118 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-33a87b37-cc32-484d-a394-c461cb192098 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:58.114572 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-33a87b37-cc32-484d-a394-c461cb192098 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:58.114993 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-33a87b37-cc32-484d-a394-c461cb192098 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:58.248672 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-33a87b37-cc32-484d-a394-c461cb192098 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:58.256240 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-33a87b37-cc32-484d-a394-c461cb192098 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840" status: 200 len: 1677 microversion: 2.1 time: 0.154645 Aug 31 01:25:58.256816 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 222/441] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:58 2022] GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:25:58.629460 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-4a9bda61-4890-4533-a7d5-9c7b46227b0f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:58.630072 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-4a9bda61-4890-4533-a7d5-9c7b46227b0f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:58.633164 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:25:58.637951 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4a9bda61-4890-4533-a7d5-9c7b46227b0f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:58.638433 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4a9bda61-4890-4533-a7d5-9c7b46227b0f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:58.638869 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4a9bda61-4890-4533-a7d5-9c7b46227b0f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:58.639559 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4a9bda61-4890-4533-a7d5-9c7b46227b0f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:58.640037 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4a9bda61-4890-4533-a7d5-9c7b46227b0f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:58.640480 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4a9bda61-4890-4533-a7d5-9c7b46227b0f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:58.656399 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-5e239901-76ee-4740-bbcb-2c2c3c5dc94d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:58.657030 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-5e239901-76ee-4740-bbcb-2c2c3c5dc94d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:58.663409 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5e239901-76ee-4740-bbcb-2c2c3c5dc94d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:58.663910 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5e239901-76ee-4740-bbcb-2c2c3c5dc94d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:58.664404 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5e239901-76ee-4740-bbcb-2c2c3c5dc94d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:58.665164 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5e239901-76ee-4740-bbcb-2c2c3c5dc94d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:58.665614 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5e239901-76ee-4740-bbcb-2c2c3c5dc94d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:58.666037 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5e239901-76ee-4740-bbcb-2c2c3c5dc94d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:58.840012 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-4a9bda61-4890-4533-a7d5-9c7b46227b0f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:58.848551 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-4a9bda61-4890-4533-a7d5-9c7b46227b0f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1737 microversion: 2.1 time: 0.222979 Aug 31 01:25:58.849324 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 220/442] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:58 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1737 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:25:58.850543 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-5e239901-76ee-4740-bbcb-2c2c3c5dc94d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:58.859372 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-5e239901-76ee-4740-bbcb-2c2c3c5dc94d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:58.860822 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-5e239901-76ee-4740-bbcb-2c2c3c5dc94d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:58.861978 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-5e239901-76ee-4740-bbcb-2c2c3c5dc94d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1810 microversion: 2.20 time: 0.209619 Aug 31 01:25:58.862523 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 223/443] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:58 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1810 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 01:25:59.277638 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-af4c78c6-fc56-4e77-9eb6-987cf0aa3fb6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:59.278247 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-af4c78c6-fc56-4e77-9eb6-987cf0aa3fb6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 8ce564c8-7a17-4de1-96b9-3737fca73840] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:59.284373 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-af4c78c6-fc56-4e77-9eb6-987cf0aa3fb6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:59.284902 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-af4c78c6-fc56-4e77-9eb6-987cf0aa3fb6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:59.285339 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-af4c78c6-fc56-4e77-9eb6-987cf0aa3fb6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:59.286027 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-af4c78c6-fc56-4e77-9eb6-987cf0aa3fb6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:59.286479 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-af4c78c6-fc56-4e77-9eb6-987cf0aa3fb6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:59.286940 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-af4c78c6-fc56-4e77-9eb6-987cf0aa3fb6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:59.426895 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-af4c78c6-fc56-4e77-9eb6-987cf0aa3fb6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:25:59.436348 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-af4c78c6-fc56-4e77-9eb6-987cf0aa3fb6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840" status: 200 len: 1677 microversion: 2.1 time: 0.162543 Aug 31 01:25:59.436994 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 221/444] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:59 2022] GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:25:59.869453 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-5a3e12b2-8153-492e-ab3f-63f3551a7cf7 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:59.870065 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-5a3e12b2-8153-492e-ab3f-63f3551a7cf7 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:59.876821 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5a3e12b2-8153-492e-ab3f-63f3551a7cf7 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:59.877311 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5a3e12b2-8153-492e-ab3f-63f3551a7cf7 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:59.877746 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5a3e12b2-8153-492e-ab3f-63f3551a7cf7 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:59.878436 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5a3e12b2-8153-492e-ab3f-63f3551a7cf7 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:59.878889 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5a3e12b2-8153-492e-ab3f-63f3551a7cf7 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:59.879311 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5a3e12b2-8153-492e-ab3f-63f3551a7cf7 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:59.895476 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-84c24827-5b6a-4934-ad99-9361060f9a66 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:25:59.897262 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-84c24827-5b6a-4934-ad99-9361060f9a66 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:25:59.908584 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-84c24827-5b6a-4934-ad99-9361060f9a66 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:59.909641 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-84c24827-5b6a-4934-ad99-9361060f9a66 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:59.910366 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-84c24827-5b6a-4934-ad99-9361060f9a66 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:25:59.911080 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-84c24827-5b6a-4934-ad99-9361060f9a66 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:25:59.911535 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-84c24827-5b6a-4934-ad99-9361060f9a66 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:25:59.911956 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-84c24827-5b6a-4934-ad99-9361060f9a66 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:00.083777 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-5a3e12b2-8153-492e-ab3f-63f3551a7cf7 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:00.096894 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-5a3e12b2-8153-492e-ab3f-63f3551a7cf7 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1737 microversion: 2.1 time: 0.231195 Aug 31 01:26:00.097979 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 224/445] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:25:59 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1737 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:26:00.102982 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [req-d0ff5c0c-0cae-4608-b304-7a16ddcee1d3 req-cd636aee-20e2-494b-a823-f42a64d7bc12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ce564c8-7a17-4de1-96b9-3737fca73840", "name": "network-vif-deleted", "tag": "06a28bab-3d45-4348-850c-bb3c714f41df"}]} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:26:00.113107 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-d0ff5c0c-0cae-4608-b304-7a16ddcee1d3 req-cd636aee-20e2-494b-a823-f42a64d7bc12 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:00.113727 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-d0ff5c0c-0cae-4608-b304-7a16ddcee1d3 req-cd636aee-20e2-494b-a823-f42a64d7bc12 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:00.114276 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-d0ff5c0c-0cae-4608-b304-7a16ddcee1d3 req-cd636aee-20e2-494b-a823-f42a64d7bc12 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:00.129823 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-84c24827-5b6a-4934-ad99-9361060f9a66 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:00.140762 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-84c24827-5b6a-4934-ad99-9361060f9a66 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:00.142600 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-84c24827-5b6a-4934-ad99-9361060f9a66 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:00.143827 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-84c24827-5b6a-4934-ad99-9361060f9a66 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1797 microversion: 2.20 time: 0.253391 Aug 31 01:26:00.144389 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 222/446] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:25:59 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1797 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 01:26:00.151458 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.compute.server_external_events [req-d0ff5c0c-0cae-4608-b304-7a16ddcee1d3 req-cd636aee-20e2-494b-a823-f42a64d7bc12 service nova] Creating event network-vif-deleted:06a28bab-3d45-4348-850c-bb3c714f41df for instance 8ce564c8-7a17-4de1-96b9-3737fca73840 on hv-cinder-85528 Aug 31 01:26:00.164065 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [req-d0ff5c0c-0cae-4608-b304-7a16ddcee1d3 req-cd636aee-20e2-494b-a823-f42a64d7bc12 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063494 Aug 31 01:26:00.164937 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 225/447] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:26:00.458023 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-6c6a5a3c-aab3-41dd-bfc1-4124edca0b3e tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:00.458633 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-6c6a5a3c-aab3-41dd-bfc1-4124edca0b3e tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 8ce564c8-7a17-4de1-96b9-3737fca73840] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:00.464890 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6c6a5a3c-aab3-41dd-bfc1-4124edca0b3e tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:00.465377 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6c6a5a3c-aab3-41dd-bfc1-4124edca0b3e tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:00.471696 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6c6a5a3c-aab3-41dd-bfc1-4124edca0b3e tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:00.471696 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6c6a5a3c-aab3-41dd-bfc1-4124edca0b3e tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:00.471696 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6c6a5a3c-aab3-41dd-bfc1-4124edca0b3e tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:00.471696 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6c6a5a3c-aab3-41dd-bfc1-4124edca0b3e tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:00.500217 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6c6a5a3c-aab3-41dd-bfc1-4124edca0b3e tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:00.500217 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6c6a5a3c-aab3-41dd-bfc1-4124edca0b3e tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:00.500217 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6c6a5a3c-aab3-41dd-bfc1-4124edca0b3e tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:00.500217 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.objects.instance [None req-6c6a5a3c-aab3-41dd-bfc1-4124edca0b3e tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lazy-loading 'fault' on Instance uuid 8ce564c8-7a17-4de1-96b9-3737fca73840 {{(pid=121025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:26:00.544135 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-6c6a5a3c-aab3-41dd-bfc1-4124edca0b3e tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:00.553155 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-6c6a5a3c-aab3-41dd-bfc1-4124edca0b3e tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840" status: 200 len: 1330 microversion: 2.1 time: 0.099262 Aug 31 01:26:00.554879 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 223/448] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:00 2022] GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840 => generated 1330 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:26:01.125216 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-90285d2a-8394-4006-9600-99803412f227 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:01.125907 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-90285d2a-8394-4006-9600-99803412f227 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:01.127873 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:26:01.132660 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-90285d2a-8394-4006-9600-99803412f227 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:01.133169 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-90285d2a-8394-4006-9600-99803412f227 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:01.133596 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-90285d2a-8394-4006-9600-99803412f227 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:01.135382 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-90285d2a-8394-4006-9600-99803412f227 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:01.135382 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-90285d2a-8394-4006-9600-99803412f227 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:01.135382 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-90285d2a-8394-4006-9600-99803412f227 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:01.275356 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-90285d2a-8394-4006-9600-99803412f227 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:01.284035 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-90285d2a-8394-4006-9600-99803412f227 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1737 microversion: 2.1 time: 0.163690 Aug 31 01:26:01.284594 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 226/449] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:01 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:26:01.575074 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-ecf9a583-074e-46df-ba69-1ef02d0bd2b9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:01.575592 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-ecf9a583-074e-46df-ba69-1ef02d0bd2b9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 8ce564c8-7a17-4de1-96b9-3737fca73840] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:01.582425 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ecf9a583-074e-46df-ba69-1ef02d0bd2b9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:01.582900 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ecf9a583-074e-46df-ba69-1ef02d0bd2b9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:01.583323 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ecf9a583-074e-46df-ba69-1ef02d0bd2b9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:01.583999 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ecf9a583-074e-46df-ba69-1ef02d0bd2b9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:01.584443 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ecf9a583-074e-46df-ba69-1ef02d0bd2b9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:01.584899 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ecf9a583-074e-46df-ba69-1ef02d0bd2b9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:01.598727 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.wsgi [None req-ecf9a583-074e-46df-ba69-1ef02d0bd2b9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] HTTP exception thrown: Instance 8ce564c8-7a17-4de1-96b9-3737fca73840 could not be found. Aug 31 01:26:01.600329 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-ecf9a583-074e-46df-ba69-1ef02d0bd2b9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Request method failure captured: Aug 31 01:26:01.600329 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: request: GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840 HTTP/1.1 Aug 31 01:26:01.600329 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept: application/json Aug 31 01:26:01.600329 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept-Encoding: identity Aug 31 01:26:01.600329 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Connection: close Aug 31 01:26:01.600329 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Length: 0 Aug 31 01:26:01.600329 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Type: application/json Aug 31 01:26:01.600329 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Host: 10.222.0.20 Aug 31 01:26:01.600329 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Openstack-System-Scope: None Aug 31 01:26:01.600329 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: User-Agent: python-urllib3/1.26.12 Aug 31 01:26:01.600329 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Auth-Token: gAAAAABjDrfet2Sy4N8jKKJoN7i8trLl0KW7DYiW5JhaLj0L5xpx8IJJDKjwB1T51gnweVtzcKX7Vmb1NaayoFFPtTaITD4WxtfyhSUUM3_4_aZ5GptnzhJmrFo6ZwSNdxq7_gCewRQsJwS99WXQ3X8vSLGTrSznkbNFB8yNJvuQw_w6CXmffXc Aug 31 01:26:01.600329 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Id: None Aug 31 01:26:01.600329 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Name: None Aug 31 01:26:01.600329 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Identity-Status: Confirmed Aug 31 01:26:01.600329 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Is-Admin-Project: True Aug 31 01:26:01.600329 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Id: default Aug 31 01:26:01.600329 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Name: Default Aug 31 01:26:01.600329 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Id: 164da7d4776d4e9f8cf6497aa784d312 Aug 31 01:26:01.600329 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Name: tempest-AttachVolumeNegativeTest-1582720348 Aug 31 01:26:01.600329 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Role: member,reader Aug 31 01:26:01.600329 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Roles: member,reader Aug 31 01:26:01.601918 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/164da7d4776d4e9f8cf6497aa784d312"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_164da7d4776d4e9f8cf6497aa784d312", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/164da7d4776d4e9f8cf6497aa784d312"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/164da7d4776d4e9f8cf6497aa784d312"}]}] Aug 31 01:26:01.601918 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant: tempest-AttachVolumeNegativeTest-1582720348 Aug 31 01:26:01.601918 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Id: 164da7d4776d4e9f8cf6497aa784d312 Aug 31 01:26:01.601918 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1582720348 Aug 31 01:26:01.601918 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User: tempest-AttachVolumeNegativeTest-1582720348-project Aug 31 01:26:01.601918 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Id: default Aug 31 01:26:01.601918 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Name: Default Aug 31 01:26:01.601918 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Id: 52ed99737fd240789bb682fd9bf11be3 Aug 31 01:26:01.601918 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Name: tempest-AttachVolumeNegativeTest-1582720348-project Aug 31 01:26:01.601918 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: method: > Aug 31 01:26:01.601918 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: exception: Instance 8ce564c8-7a17-4de1-96b9-3737fca73840 could not be found. Aug 31 01:26:01.601918 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: action_args: {'id': '8ce564c8-7a17-4de1-96b9-3737fca73840'} Aug 31 01:26:01.602781 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:26:01.602781 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:26:01.602781 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:26:01.602781 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:26:01.602781 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:26:01.602781 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:26:01.602781 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:26:01.602781 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:26:01.602781 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:26:01.602781 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:26:01.602781 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ce564c8-7a17-4de1-96b9-3737fca73840 could not be found. Aug 31 01:26:01.602781 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:26:01.602781 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:26:01.602781 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:26:01.602781 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:26:01.602781 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:26:01.602781 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:26:01.602781 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:26:01.602781 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:26:01.602781 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:26:01.604174 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:26:01.604174 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:26:01.604174 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:26:01.604174 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:26:01.604174 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:26:01.604174 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:26:01.604174 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:26:01.604174 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ce564c8-7a17-4de1-96b9-3737fca73840 could not be found. Aug 31 01:26:01.604174 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:26:01.604174 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:26:01.604174 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:26:01.604174 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:26:01.604174 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:26:01.604174 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:26:01.604174 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:26:01.604174 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:26:01.604174 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ce564c8-7a17-4de1-96b9-3737fca73840 could not be found. Aug 31 01:26:01.604174 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:26:01.605419 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-ecf9a583-074e-46df-ba69-1ef02d0bd2b9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Returning 404 to user: Instance 8ce564c8-7a17-4de1-96b9-3737fca73840 could not be found. {{(pid=121025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:26:01.605419 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-ecf9a583-074e-46df-ba69-1ef02d0bd2b9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840" status: 404 len: 111 microversion: 2.1 time: 0.030601 Aug 31 01:26:01.605419 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 224/450] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:01 2022] GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:26:01.610532 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-dd5078b2-7edb-4cc3-9582-dd46a554bd4e tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '.version_select at 0x7f1fe185c040>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:01.690422 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-dd5078b2-7edb-4cc3-9582-dd46a554bd4e tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-60556780" status: 202 len: 0 microversion: 2.1 time: 0.083632 Aug 31 01:26:01.690990 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 227/451] 10.222.0.20 () {58 vars in 1215 bytes} [Wed Aug 31 01:26:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-60556780 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 01:26:02.306393 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-5f2ec731-8e15-48d7-b78a-02f8f06be788 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:02.306997 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-5f2ec731-8e15-48d7-b78a-02f8f06be788 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:02.312995 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5f2ec731-8e15-48d7-b78a-02f8f06be788 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:02.313485 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5f2ec731-8e15-48d7-b78a-02f8f06be788 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:02.313917 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5f2ec731-8e15-48d7-b78a-02f8f06be788 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:02.314608 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5f2ec731-8e15-48d7-b78a-02f8f06be788 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:02.315058 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5f2ec731-8e15-48d7-b78a-02f8f06be788 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:02.315479 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5f2ec731-8e15-48d7-b78a-02f8f06be788 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:02.449516 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-5f2ec731-8e15-48d7-b78a-02f8f06be788 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:02.457888 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-5f2ec731-8e15-48d7-b78a-02f8f06be788 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1737 microversion: 2.1 time: 0.155938 Aug 31 01:26:02.458445 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 225/452] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:02 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:26:02.644632 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-76a4d743-d875-4573-aa42-c8ee0babfe0f tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Action: 'create', calling method: .version_select at 0x7f1fe179d700>, body: {"keypair": {"name": "tempest-keypair-1527051928", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpTQnW3g0U+lVPuXK58OG6XgcrTHNkKH5fVffoWjGI2foYwOcI2zGJbJn7jqyDW9PJHVehxVmiZoKi46dRosngPPwMrhmkcjqOmkBBEn3betbQJyn3OVYXVSYhk1OXfpw=="}} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:26:02.660827 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.quota [None req-76a4d743-d875-4573-aa42-c8ee0babfe0f tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Getting quotas for project 164da7d4776d4e9f8cf6497aa784d312. Resources: {'key_pairs'} {{(pid=121026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 01:26:02.664615 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.quota [None req-76a4d743-d875-4573-aa42-c8ee0babfe0f tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Getting quotas for user 52ed99737fd240789bb682fd9bf11be3 and project 164da7d4776d4e9f8cf6497aa784d312. Resources: {'key_pairs'} {{(pid=121026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 01:26:02.726060 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-76a4d743-d875-4573-aa42-c8ee0babfe0f tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.086030 Aug 31 01:26:02.726672 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 228/453] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Aug 31 01:26:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:26:03.479346 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-c79ff1e3-96fb-44f9-8cdd-d7be650b2b2c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:03.480583 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-c79ff1e3-96fb-44f9-8cdd-d7be650b2b2c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:03.487074 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c79ff1e3-96fb-44f9-8cdd-d7be650b2b2c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:03.487590 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c79ff1e3-96fb-44f9-8cdd-d7be650b2b2c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:03.488098 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c79ff1e3-96fb-44f9-8cdd-d7be650b2b2c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:03.488836 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c79ff1e3-96fb-44f9-8cdd-d7be650b2b2c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:03.489290 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c79ff1e3-96fb-44f9-8cdd-d7be650b2b2c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:03.489712 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c79ff1e3-96fb-44f9-8cdd-d7be650b2b2c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:03.639056 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-c79ff1e3-96fb-44f9-8cdd-d7be650b2b2c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:03.647414 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-c79ff1e3-96fb-44f9-8cdd-d7be650b2b2c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1737 microversion: 2.1 time: 0.172482 Aug 31 01:26:03.648047 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 226/454] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:03 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:26:04.669843 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-f3e2405e-61d8-43b9-98b5-72be13b889ed tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:04.671161 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-f3e2405e-61d8-43b9-98b5-72be13b889ed tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:04.677202 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f3e2405e-61d8-43b9-98b5-72be13b889ed tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:04.677687 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f3e2405e-61d8-43b9-98b5-72be13b889ed tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:04.678131 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f3e2405e-61d8-43b9-98b5-72be13b889ed tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:04.678830 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f3e2405e-61d8-43b9-98b5-72be13b889ed tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:04.679281 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f3e2405e-61d8-43b9-98b5-72be13b889ed tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:04.679700 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f3e2405e-61d8-43b9-98b5-72be13b889ed tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:04.813170 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-f3e2405e-61d8-43b9-98b5-72be13b889ed tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:04.822290 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-f3e2405e-61d8-43b9-98b5-72be13b889ed tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1737 microversion: 2.1 time: 0.156389 Aug 31 01:26:04.822872 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 229/455] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:04 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:26:04.862241 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-9ed94bae-7d46-41f6-a4ab-155d6644948a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-329596919", "imageRef": "ed6d3236-defa-4ccf-90ba-343c0d0ad58e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0760f9a5-d813-4a0f-bcef-9988cda0c948"}], "security_groups": [{"name": "tempest-securitygroup--1638121291"}], "key_name": "tempest-keypair-1527051928", "user_data": "}} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:26:04.965916 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.network.neutron [None req-9ed94bae-7d46-41f6-a4ab-155d6644948a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] validate_networks() for [('0760f9a5-d813-4a0f-bcef-9988cda0c948', None, None, None, None, None)] {{(pid=121025) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 01:26:05.331470 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-9ed94bae-7d46-41f6-a4ab-155d6644948a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Flavor limits 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 01:26:05.331885 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-9ed94bae-7d46-41f6-a4ab-155d6644948a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Image limits 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 01:26:05.332379 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-9ed94bae-7d46-41f6-a4ab-155d6644948a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Flavor pref 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 01:26:05.332806 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-9ed94bae-7d46-41f6-a4ab-155d6644948a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Image pref 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 01:26:05.333209 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-9ed94bae-7d46-41f6-a4ab-155d6644948a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 01:26:05.342308 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9ed94bae-7d46-41f6-a4ab-155d6644948a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:05.342774 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9ed94bae-7d46-41f6-a4ab-155d6644948a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:05.343193 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9ed94bae-7d46-41f6-a4ab-155d6644948a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:05.343903 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9ed94bae-7d46-41f6-a4ab-155d6644948a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:05.344347 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9ed94bae-7d46-41f6-a4ab-155d6644948a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:05.344781 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9ed94bae-7d46-41f6-a4ab-155d6644948a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:05.360896 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.quota [None req-9ed94bae-7d46-41f6-a4ab-155d6644948a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Getting quotas for project 164da7d4776d4e9f8cf6497aa784d312. Resources: {'instances', 'cores', 'ram'} {{(pid=121025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 01:26:05.364750 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.quota [None req-9ed94bae-7d46-41f6-a4ab-155d6644948a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Getting quotas for user 52ed99737fd240789bb682fd9bf11be3 and project 164da7d4776d4e9f8cf6497aa784d312. Resources: {'instances', 'cores', 'ram'} {{(pid=121025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 01:26:05.375838 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-9ed94bae-7d46-41f6-a4ab-155d6644948a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Going to run 1 instances... {{(pid=121025) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 01:26:05.378211 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-9ed94bae-7d46-41f6-a4ab-155d6644948a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: acd1b630-d842-47ea-8019-f405c41ad7d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ed6d3236-defa-4ccf-90ba-343c0d0ad58e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 01:26:05.527603 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-9ed94bae-7d46-41f6-a4ab-155d6644948a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.669397 Aug 31 01:26:05.528163 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 227/456] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 31 01:26:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 01:26:05.538818 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-f5d2ff5b-1dc4-447d-8f7e-618f48d84917 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:05.539423 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-f5d2ff5b-1dc4-447d-8f7e-618f48d84917 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: acd1b630-d842-47ea-8019-f405c41ad7d3] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:05.593822 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-f5d2ff5b-1dc4-447d-8f7e-618f48d84917 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:05.600850 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-f5d2ff5b-1dc4-447d-8f7e-618f48d84917 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3" status: 200 len: 1241 microversion: 2.1 time: 0.065786 Aug 31 01:26:05.601606 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 230/457] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:05 2022] GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:26:05.843465 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-72dedc4b-9089-4845-9ac0-75f6a15347e5 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:05.844075 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-72dedc4b-9089-4845-9ac0-75f6a15347e5 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:05.850674 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-72dedc4b-9089-4845-9ac0-75f6a15347e5 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:05.851598 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-72dedc4b-9089-4845-9ac0-75f6a15347e5 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:05.851722 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-72dedc4b-9089-4845-9ac0-75f6a15347e5 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:05.852312 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-72dedc4b-9089-4845-9ac0-75f6a15347e5 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:05.852787 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-72dedc4b-9089-4845-9ac0-75f6a15347e5 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:05.853213 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-72dedc4b-9089-4845-9ac0-75f6a15347e5 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:05.988094 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-72dedc4b-9089-4845-9ac0-75f6a15347e5 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:05.997192 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-72dedc4b-9089-4845-9ac0-75f6a15347e5 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1737 microversion: 2.1 time: 0.157646 Aug 31 01:26:05.997757 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 228/458] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:05 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:26:06.621117 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-3f5f6a2b-5b68-438b-984e-1d81e5435cd9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:06.621676 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-3f5f6a2b-5b68-438b-984e-1d81e5435cd9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: acd1b630-d842-47ea-8019-f405c41ad7d3] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:06.627926 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3f5f6a2b-5b68-438b-984e-1d81e5435cd9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:06.628405 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3f5f6a2b-5b68-438b-984e-1d81e5435cd9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:06.628890 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3f5f6a2b-5b68-438b-984e-1d81e5435cd9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:06.629578 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3f5f6a2b-5b68-438b-984e-1d81e5435cd9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:06.630033 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3f5f6a2b-5b68-438b-984e-1d81e5435cd9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:06.630456 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3f5f6a2b-5b68-438b-984e-1d81e5435cd9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:06.692181 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-3f5f6a2b-5b68-438b-984e-1d81e5435cd9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:06.701064 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-3f5f6a2b-5b68-438b-984e-1d81e5435cd9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3" status: 200 len: 1245 microversion: 2.1 time: 0.083969 Aug 31 01:26:06.701635 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 231/459] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:06 2022] GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:26:07.018140 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-1b4ae79e-8fb2-4e81-b9d8-2a5cd9d7ea89 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:07.018743 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-1b4ae79e-8fb2-4e81-b9d8-2a5cd9d7ea89 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:07.025941 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1b4ae79e-8fb2-4e81-b9d8-2a5cd9d7ea89 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:07.026415 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1b4ae79e-8fb2-4e81-b9d8-2a5cd9d7ea89 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:07.026843 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1b4ae79e-8fb2-4e81-b9d8-2a5cd9d7ea89 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:07.027559 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1b4ae79e-8fb2-4e81-b9d8-2a5cd9d7ea89 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:07.027962 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1b4ae79e-8fb2-4e81-b9d8-2a5cd9d7ea89 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:07.028382 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1b4ae79e-8fb2-4e81-b9d8-2a5cd9d7ea89 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:07.155738 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-1b4ae79e-8fb2-4e81-b9d8-2a5cd9d7ea89 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:07.164219 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-1b4ae79e-8fb2-4e81-b9d8-2a5cd9d7ea89 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1737 microversion: 2.1 time: 0.149880 Aug 31 01:26:07.164788 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 229/460] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:07 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:26:07.722457 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-89ad8b4f-b5e1-496d-a417-e12d5a01b7c1 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:07.723732 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-89ad8b4f-b5e1-496d-a417-e12d5a01b7c1 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: acd1b630-d842-47ea-8019-f405c41ad7d3] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:07.732862 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-89ad8b4f-b5e1-496d-a417-e12d5a01b7c1 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:07.733377 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-89ad8b4f-b5e1-496d-a417-e12d5a01b7c1 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:07.734006 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-89ad8b4f-b5e1-496d-a417-e12d5a01b7c1 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:07.734899 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-89ad8b4f-b5e1-496d-a417-e12d5a01b7c1 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:07.735355 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-89ad8b4f-b5e1-496d-a417-e12d5a01b7c1 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:07.735780 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-89ad8b4f-b5e1-496d-a417-e12d5a01b7c1 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:07.801058 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-89ad8b4f-b5e1-496d-a417-e12d5a01b7c1 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:07.809413 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-89ad8b4f-b5e1-496d-a417-e12d5a01b7c1 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3" status: 200 len: 1301 microversion: 2.1 time: 0.091014 Aug 31 01:26:07.811031 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 232/461] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:07 2022] GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3 => generated 1301 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:26:08.185196 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-929a7941-6480-4b02-b5c3-05d5af549dd9 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:08.185884 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-929a7941-6480-4b02-b5c3-05d5af549dd9 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:08.192370 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-929a7941-6480-4b02-b5c3-05d5af549dd9 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:08.196458 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-929a7941-6480-4b02-b5c3-05d5af549dd9 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:08.196458 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-929a7941-6480-4b02-b5c3-05d5af549dd9 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:08.196458 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-929a7941-6480-4b02-b5c3-05d5af549dd9 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:08.196458 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-929a7941-6480-4b02-b5c3-05d5af549dd9 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:08.196862 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-929a7941-6480-4b02-b5c3-05d5af549dd9 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:08.568991 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-929a7941-6480-4b02-b5c3-05d5af549dd9 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:08.575587 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-929a7941-6480-4b02-b5c3-05d5af549dd9 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1737 microversion: 2.1 time: 0.393977 Aug 31 01:26:08.576276 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 230/462] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:08 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1737 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:26:08.830731 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-4c185683-bd5f-42a9-a2b1-61db8440a7ad tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:08.831294 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-4c185683-bd5f-42a9-a2b1-61db8440a7ad tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: acd1b630-d842-47ea-8019-f405c41ad7d3] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:08.838371 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4c185683-bd5f-42a9-a2b1-61db8440a7ad tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:08.851193 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4c185683-bd5f-42a9-a2b1-61db8440a7ad tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:08.851193 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4c185683-bd5f-42a9-a2b1-61db8440a7ad tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:08.851193 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4c185683-bd5f-42a9-a2b1-61db8440a7ad tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:08.851193 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4c185683-bd5f-42a9-a2b1-61db8440a7ad tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:08.851556 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4c185683-bd5f-42a9-a2b1-61db8440a7ad tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:08.971481 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-4c185683-bd5f-42a9-a2b1-61db8440a7ad tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:08.979769 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-4c185683-bd5f-42a9-a2b1-61db8440a7ad tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3" status: 200 len: 1367 microversion: 2.1 time: 0.153214 Aug 31 01:26:08.980334 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 233/463] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:08 2022] GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:26:09.409052 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-07aeecf3-b8ee-4ab3-a1cc-6c99174c8f93 req-1a34af57-2707-4077-adc3-ef71969f81be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acd1b630-d842-47ea-8019-f405c41ad7d3", "tag": "56319e02-73a5-4ec7-acf3-90f2592a466e"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:26:09.419216 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-07aeecf3-b8ee-4ab3-a1cc-6c99174c8f93 req-1a34af57-2707-4077-adc3-ef71969f81be service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:09.424983 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-07aeecf3-b8ee-4ab3-a1cc-6c99174c8f93 req-1a34af57-2707-4077-adc3-ef71969f81be service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:09.424983 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-07aeecf3-b8ee-4ab3-a1cc-6c99174c8f93 req-1a34af57-2707-4077-adc3-ef71969f81be service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:09.431795 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-07aeecf3-b8ee-4ab3-a1cc-6c99174c8f93 req-1a34af57-2707-4077-adc3-ef71969f81be service nova] Creating event network-changed:56319e02-73a5-4ec7-acf3-90f2592a466e for instance acd1b630-d842-47ea-8019-f405c41ad7d3 on hv-cinder-85528 Aug 31 01:26:09.437242 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-07aeecf3-b8ee-4ab3-a1cc-6c99174c8f93 req-1a34af57-2707-4077-adc3-ef71969f81be service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031804 Aug 31 01:26:09.437852 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 231/464] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:26:09.597277 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-a6890907-4f21-42e0-bb4f-e7492a87c4ed tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:09.597917 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-a6890907-4f21-42e0-bb4f-e7492a87c4ed tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:09.603860 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a6890907-4f21-42e0-bb4f-e7492a87c4ed tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:09.604342 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a6890907-4f21-42e0-bb4f-e7492a87c4ed tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:09.604796 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a6890907-4f21-42e0-bb4f-e7492a87c4ed tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:09.605486 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a6890907-4f21-42e0-bb4f-e7492a87c4ed tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:09.605934 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a6890907-4f21-42e0-bb4f-e7492a87c4ed tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:09.606354 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a6890907-4f21-42e0-bb4f-e7492a87c4ed tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:09.737002 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-a6890907-4f21-42e0-bb4f-e7492a87c4ed tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:09.740489 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:26:09.746156 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-a6890907-4f21-42e0-bb4f-e7492a87c4ed tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1737 microversion: 2.1 time: 0.153124 Aug 31 01:26:09.746843 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 234/465] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:09 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:26:10.002462 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-ac9a12c2-1d69-4637-b169-f9c2814db999 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:10.003264 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-ac9a12c2-1d69-4637-b169-f9c2814db999 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: acd1b630-d842-47ea-8019-f405c41ad7d3] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:10.010775 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ac9a12c2-1d69-4637-b169-f9c2814db999 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:10.011255 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ac9a12c2-1d69-4637-b169-f9c2814db999 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:10.011690 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ac9a12c2-1d69-4637-b169-f9c2814db999 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:10.012371 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ac9a12c2-1d69-4637-b169-f9c2814db999 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:10.012851 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ac9a12c2-1d69-4637-b169-f9c2814db999 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:10.013275 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ac9a12c2-1d69-4637-b169-f9c2814db999 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:10.143320 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-ac9a12c2-1d69-4637-b169-f9c2814db999 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:10.150935 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-ac9a12c2-1d69-4637-b169-f9c2814db999 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3" status: 200 len: 1367 microversion: 2.1 time: 0.153466 Aug 31 01:26:10.151591 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 232/466] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:09 2022] GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:26:10.767766 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-90fd2e18-81d6-4259-ac41-c614664da2b2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:10.768429 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-90fd2e18-81d6-4259-ac41-c614664da2b2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:10.775384 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-90fd2e18-81d6-4259-ac41-c614664da2b2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:10.775864 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-90fd2e18-81d6-4259-ac41-c614664da2b2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:10.776296 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-90fd2e18-81d6-4259-ac41-c614664da2b2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:10.777006 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-90fd2e18-81d6-4259-ac41-c614664da2b2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:10.777460 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-90fd2e18-81d6-4259-ac41-c614664da2b2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:10.777881 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-90fd2e18-81d6-4259-ac41-c614664da2b2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:10.911834 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-90fd2e18-81d6-4259-ac41-c614664da2b2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:10.920580 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-90fd2e18-81d6-4259-ac41-c614664da2b2 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1737 microversion: 2.1 time: 0.157094 Aug 31 01:26:10.921169 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 235/467] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:10 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:26:11.171375 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-2019c802-4e93-47d9-8dad-145bb8cf08a2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:11.172011 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-2019c802-4e93-47d9-8dad-145bb8cf08a2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: acd1b630-d842-47ea-8019-f405c41ad7d3] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:11.178442 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2019c802-4e93-47d9-8dad-145bb8cf08a2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:11.178922 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2019c802-4e93-47d9-8dad-145bb8cf08a2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:11.179352 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2019c802-4e93-47d9-8dad-145bb8cf08a2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:11.180048 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2019c802-4e93-47d9-8dad-145bb8cf08a2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:11.180496 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2019c802-4e93-47d9-8dad-145bb8cf08a2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:11.180949 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2019c802-4e93-47d9-8dad-145bb8cf08a2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:11.306542 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-2019c802-4e93-47d9-8dad-145bb8cf08a2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:11.314015 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-2019c802-4e93-47d9-8dad-145bb8cf08a2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3" status: 200 len: 1367 microversion: 2.1 time: 0.146975 Aug 31 01:26:11.314580 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 233/468] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:11 2022] GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:26:11.941657 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-dc18c98a-54aa-4466-a97b-a5f4457ae568 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:11.942236 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-dc18c98a-54aa-4466-a97b-a5f4457ae568 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:11.948552 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-dc18c98a-54aa-4466-a97b-a5f4457ae568 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:11.949053 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-dc18c98a-54aa-4466-a97b-a5f4457ae568 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:11.949481 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-dc18c98a-54aa-4466-a97b-a5f4457ae568 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:11.950156 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-dc18c98a-54aa-4466-a97b-a5f4457ae568 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:11.950598 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-dc18c98a-54aa-4466-a97b-a5f4457ae568 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:11.951013 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-dc18c98a-54aa-4466-a97b-a5f4457ae568 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:12.086880 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-dc18c98a-54aa-4466-a97b-a5f4457ae568 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:12.094852 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-dc18c98a-54aa-4466-a97b-a5f4457ae568 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1737 microversion: 2.1 time: 0.157109 Aug 31 01:26:12.095407 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 236/469] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:11 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:26:12.335230 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-6a1ecb9a-6e38-4f83-b78c-62bb8e9ce7a2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:12.335897 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-6a1ecb9a-6e38-4f83-b78c-62bb8e9ce7a2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: acd1b630-d842-47ea-8019-f405c41ad7d3] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:12.342381 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6a1ecb9a-6e38-4f83-b78c-62bb8e9ce7a2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:12.342865 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6a1ecb9a-6e38-4f83-b78c-62bb8e9ce7a2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:12.343306 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6a1ecb9a-6e38-4f83-b78c-62bb8e9ce7a2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:12.343996 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6a1ecb9a-6e38-4f83-b78c-62bb8e9ce7a2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:12.344449 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6a1ecb9a-6e38-4f83-b78c-62bb8e9ce7a2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:12.344915 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6a1ecb9a-6e38-4f83-b78c-62bb8e9ce7a2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:12.471283 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-6a1ecb9a-6e38-4f83-b78c-62bb8e9ce7a2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:12.479516 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-6a1ecb9a-6e38-4f83-b78c-62bb8e9ce7a2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3" status: 200 len: 1367 microversion: 2.1 time: 0.148106 Aug 31 01:26:12.480077 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 234/470] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:12 2022] GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:26:13.117080 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-89523cff-cc5e-4356-a8c7-0775a24f2fbd tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:13.118131 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-89523cff-cc5e-4356-a8c7-0775a24f2fbd tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:13.124473 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-89523cff-cc5e-4356-a8c7-0775a24f2fbd tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:13.124986 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-89523cff-cc5e-4356-a8c7-0775a24f2fbd tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:13.125423 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-89523cff-cc5e-4356-a8c7-0775a24f2fbd tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:13.126101 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-89523cff-cc5e-4356-a8c7-0775a24f2fbd tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:13.126548 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-89523cff-cc5e-4356-a8c7-0775a24f2fbd tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:13.126965 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-89523cff-cc5e-4356-a8c7-0775a24f2fbd tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:13.258550 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-89523cff-cc5e-4356-a8c7-0775a24f2fbd tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:13.266732 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-89523cff-cc5e-4356-a8c7-0775a24f2fbd tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1737 microversion: 2.1 time: 0.153612 Aug 31 01:26:13.267288 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 237/471] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:13 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:26:13.500018 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-51c9b226-d8af-46d3-9405-5276034860fb tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:13.500632 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-51c9b226-d8af-46d3-9405-5276034860fb tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: acd1b630-d842-47ea-8019-f405c41ad7d3] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:13.507149 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-51c9b226-d8af-46d3-9405-5276034860fb tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:13.507631 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-51c9b226-d8af-46d3-9405-5276034860fb tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:13.508112 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-51c9b226-d8af-46d3-9405-5276034860fb tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:13.509365 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-51c9b226-d8af-46d3-9405-5276034860fb tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:13.509827 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-51c9b226-d8af-46d3-9405-5276034860fb tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:13.510250 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-51c9b226-d8af-46d3-9405-5276034860fb tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:13.643803 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-51c9b226-d8af-46d3-9405-5276034860fb tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:13.651542 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-51c9b226-d8af-46d3-9405-5276034860fb tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3" status: 200 len: 1367 microversion: 2.1 time: 0.155371 Aug 31 01:26:13.652100 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 235/472] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:13 2022] GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:26:14.288228 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-791a241e-e03f-4dba-92ce-5b5974eecf2c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:14.288891 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-791a241e-e03f-4dba-92ce-5b5974eecf2c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:14.295813 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-791a241e-e03f-4dba-92ce-5b5974eecf2c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:14.296295 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-791a241e-e03f-4dba-92ce-5b5974eecf2c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:14.296735 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-791a241e-e03f-4dba-92ce-5b5974eecf2c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:14.297450 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-791a241e-e03f-4dba-92ce-5b5974eecf2c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:14.297912 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-791a241e-e03f-4dba-92ce-5b5974eecf2c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:14.298320 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-791a241e-e03f-4dba-92ce-5b5974eecf2c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:14.424483 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-791a241e-e03f-4dba-92ce-5b5974eecf2c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:14.433057 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-791a241e-e03f-4dba-92ce-5b5974eecf2c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1737 microversion: 2.1 time: 0.149004 Aug 31 01:26:14.433621 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 238/473] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:14 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:26:14.672957 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-4faf1fc7-a148-467d-81d3-7109f3c938b6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:14.673567 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-4faf1fc7-a148-467d-81d3-7109f3c938b6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: acd1b630-d842-47ea-8019-f405c41ad7d3] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:14.680369 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4faf1fc7-a148-467d-81d3-7109f3c938b6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:14.680796 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4faf1fc7-a148-467d-81d3-7109f3c938b6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:14.681332 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4faf1fc7-a148-467d-81d3-7109f3c938b6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:14.682029 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4faf1fc7-a148-467d-81d3-7109f3c938b6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:14.682486 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4faf1fc7-a148-467d-81d3-7109f3c938b6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:14.682945 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4faf1fc7-a148-467d-81d3-7109f3c938b6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:14.821312 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-4faf1fc7-a148-467d-81d3-7109f3c938b6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:14.821312 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell1:SELECT=100 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:26:14.824434 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-4faf1fc7-a148-467d-81d3-7109f3c938b6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3" status: 200 len: 1367 microversion: 2.1 time: 0.155257 Aug 31 01:26:14.825034 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 236/474] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:14 2022] GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:26:15.454078 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-0022806a-dbd1-482b-891b-9751c789b618 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:15.454685 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-0022806a-dbd1-482b-891b-9751c789b618 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:15.461625 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0022806a-dbd1-482b-891b-9751c789b618 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:15.462107 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0022806a-dbd1-482b-891b-9751c789b618 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:15.462542 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0022806a-dbd1-482b-891b-9751c789b618 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:15.463230 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0022806a-dbd1-482b-891b-9751c789b618 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:15.463682 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0022806a-dbd1-482b-891b-9751c789b618 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:15.464104 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0022806a-dbd1-482b-891b-9751c789b618 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:15.590666 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-0022806a-dbd1-482b-891b-9751c789b618 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:15.599025 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-0022806a-dbd1-482b-891b-9751c789b618 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1717 microversion: 2.1 time: 0.149059 Aug 31 01:26:15.599592 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 239/475] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:15 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1717 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:26:15.709174 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-11881b11-823a-4010-84b5-f7bfb0aab5f7 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:15.709650 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-11881b11-823a-4010-84b5-f7bfb0aab5f7 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:15.712273 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell0:SELECT=2 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:26:15.712933 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell0:SELECT=6 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:26:15.718298 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-11881b11-823a-4010-84b5-f7bfb0aab5f7 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:15.718774 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-11881b11-823a-4010-84b5-f7bfb0aab5f7 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:15.719204 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-11881b11-823a-4010-84b5-f7bfb0aab5f7 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:15.719885 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-11881b11-823a-4010-84b5-f7bfb0aab5f7 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:15.720343 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-11881b11-823a-4010-84b5-f7bfb0aab5f7 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:15.720782 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-11881b11-823a-4010-84b5-f7bfb0aab5f7 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:15.803936 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.wsgi [None req-11881b11-823a-4010-84b5-f7bfb0aab5f7 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] HTTP exception thrown: Cannot 'detach_volume' instance 380077d1-0ed7-47ac-9e19-5425164e6da1 while it is in vm_state rescued Aug 31 01:26:15.806363 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-11881b11-823a-4010-84b5-f7bfb0aab5f7 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Request method failure captured: Aug 31 01:26:15.806363 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: request: DELETE /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1/os-volume_attachments/9118fa83-f3fd-4d9c-9325-562ffc2f04d3 HTTP/1.1 Aug 31 01:26:15.806363 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept: application/json Aug 31 01:26:15.806363 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept-Encoding: identity Aug 31 01:26:15.806363 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Connection: close Aug 31 01:26:15.806363 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Length: 0 Aug 31 01:26:15.806363 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Type: application/json Aug 31 01:26:15.806363 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Host: 10.222.0.20 Aug 31 01:26:15.806363 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Openstack-System-Scope: None Aug 31 01:26:15.806363 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: User-Agent: python-urllib3/1.26.12 Aug 31 01:26:15.806363 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Auth-Token: gAAAAABjDrfcuhRqsMrMNTjo6mUtTq8SbDe9MkKQW1DPTn6rIQGU7H4zaD_aUkmczj_TdvdQczHlpInuXFz_PGsDLzVXnk0dWRrYAJmuB4iGkRs9-IEfWHKdmN10--_NmP9zX5MAawHt61YTHfjDuXxTKPEPlk6b4MU77kQiT6Ux_ynynzBaDZY Aug 31 01:26:15.806363 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Id: None Aug 31 01:26:15.806363 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Name: None Aug 31 01:26:15.806363 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Identity-Status: Confirmed Aug 31 01:26:15.806363 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Is-Admin-Project: True Aug 31 01:26:15.806363 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Id: default Aug 31 01:26:15.806363 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Name: Default Aug 31 01:26:15.806363 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Id: d58414b1dd2342d58cc7665aee50b86b Aug 31 01:26:15.806363 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2102440878 Aug 31 01:26:15.806363 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Role: member,reader Aug 31 01:26:15.806363 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Roles: member,reader Aug 31 01:26:15.807737 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d58414b1dd2342d58cc7665aee50b86b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d58414b1dd2342d58cc7665aee50b86b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d58414b1dd2342d58cc7665aee50b86b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d58414b1dd2342d58cc7665aee50b86b"}]}] Aug 31 01:26:15.807737 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2102440878 Aug 31 01:26:15.807737 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Id: d58414b1dd2342d58cc7665aee50b86b Aug 31 01:26:15.807737 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2102440878 Aug 31 01:26:15.807737 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User: tempest-ServerRescueNegativeTestJSON-2102440878-project Aug 31 01:26:15.807737 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Id: default Aug 31 01:26:15.807737 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Name: Default Aug 31 01:26:15.807737 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Id: 71d0408df86f4be0ac59cc80575a14e2 Aug 31 01:26:15.807737 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2102440878-project Aug 31 01:26:15.807737 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: method: > Aug 31 01:26:15.807737 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: exception: Cannot 'detach_volume' instance 380077d1-0ed7-47ac-9e19-5425164e6da1 while it is in vm_state rescued Aug 31 01:26:15.808420 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: action_args: {'server_id': '380077d1-0ed7-47ac-9e19-5425164e6da1', 'id': '9118fa83-f3fd-4d9c-9325-562ffc2f04d3'} Aug 31 01:26:15.808420 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:26:15.808420 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:26:15.808420 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 31 01:26:15.808420 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 31 01:26:15.808420 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 01:26:15.808420 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 01:26:15.808420 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 01:26:15.808420 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 01:26:15.808420 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 380077d1-0ed7-47ac-9e19-5425164e6da1 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 31 01:26:15.808420 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:26:15.808420 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:26:15.808420 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:26:15.808420 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:26:15.808420 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:26:15.808420 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:26:15.808420 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:26:15.808420 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:26:15.808420 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:26:15.808420 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:26:15.809804 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 31 01:26:15.809804 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 01:26:15.809804 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 01:26:15.809804 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 01:26:15.809804 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 380077d1-0ed7-47ac-9e19-5425164e6da1 while it is in vm_state rescued Aug 31 01:26:15.809804 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:26:15.809804 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:26:15.809804 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:26:15.809804 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:26:15.809804 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:26:15.809804 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:26:15.809804 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:26:15.809804 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:26:15.809804 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 380077d1-0ed7-47ac-9e19-5425164e6da1 while it is in vm_state rescued Aug 31 01:26:15.809804 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:26:15.809804 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-11881b11-823a-4010-84b5-f7bfb0aab5f7 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Returning 409 to user: Cannot 'detach_volume' instance 380077d1-0ed7-47ac-9e19-5425164e6da1 while it is in vm_state rescued {{(pid=121025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:26:15.810868 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-11881b11-823a-4010-84b5-f7bfb0aab5f7 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "DELETE /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1/os-volume_attachments/9118fa83-f3fd-4d9c-9325-562ffc2f04d3" status: 409 len: 152 microversion: 2.1 time: 0.102770 Aug 31 01:26:15.810868 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 237/476] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 31 01:26:15 2022] DELETE /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1/os-volume_attachments/9118fa83-f3fd-4d9c-9325-562ffc2f04d3 => generated 152 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 01:26:15.817236 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-ae8af19d-1a8a-4529-967a-1e2499a93866 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:26:15.817762 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-ae8af19d-1a8a-4529-967a-1e2499a93866 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:15.819626 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell0:SELECT=6 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:26:15.824509 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ae8af19d-1a8a-4529-967a-1e2499a93866 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:15.825090 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ae8af19d-1a8a-4529-967a-1e2499a93866 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:15.825521 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ae8af19d-1a8a-4529-967a-1e2499a93866 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:15.826406 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ae8af19d-1a8a-4529-967a-1e2499a93866 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:15.826859 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ae8af19d-1a8a-4529-967a-1e2499a93866 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:15.827279 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ae8af19d-1a8a-4529-967a-1e2499a93866 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:15.844824 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-be45fb1e-65b6-4eb7-9669-9012568bc1bb req-adc7bfb5-28d5-4759-8573-9d57a2d39d9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acd1b630-d842-47ea-8019-f405c41ad7d3", "name": "network-vif-plugged", "status": "completed", "tag": "56319e02-73a5-4ec7-acf3-90f2592a466e"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:26:15.856280 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-be45fb1e-65b6-4eb7-9669-9012568bc1bb req-adc7bfb5-28d5-4759-8573-9d57a2d39d9b service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:15.856819 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-be45fb1e-65b6-4eb7-9669-9012568bc1bb req-adc7bfb5-28d5-4759-8573-9d57a2d39d9b service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:15.857279 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-be45fb1e-65b6-4eb7-9669-9012568bc1bb req-adc7bfb5-28d5-4759-8573-9d57a2d39d9b service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:15.868475 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-be45fb1e-65b6-4eb7-9669-9012568bc1bb req-adc7bfb5-28d5-4759-8573-9d57a2d39d9b service nova] Creating event network-vif-plugged:56319e02-73a5-4ec7-acf3-90f2592a466e for instance acd1b630-d842-47ea-8019-f405c41ad7d3 on hv-cinder-85528 Aug 31 01:26:15.875091 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-be45fb1e-65b6-4eb7-9669-9012568bc1bb req-adc7bfb5-28d5-4759-8573-9d57a2d39d9b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033034 Aug 31 01:26:15.875091 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 238/477] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:26:15.879216 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-76a2a5ea-5822-4b9d-880d-ba6d1ba87a62 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:15.879980 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-76a2a5ea-5822-4b9d-880d-ba6d1ba87a62 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: acd1b630-d842-47ea-8019-f405c41ad7d3] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:15.887124 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-76a2a5ea-5822-4b9d-880d-ba6d1ba87a62 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:15.887612 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-76a2a5ea-5822-4b9d-880d-ba6d1ba87a62 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:15.888049 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-76a2a5ea-5822-4b9d-880d-ba6d1ba87a62 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:15.888764 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-76a2a5ea-5822-4b9d-880d-ba6d1ba87a62 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:15.889218 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-76a2a5ea-5822-4b9d-880d-ba6d1ba87a62 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:15.889641 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-76a2a5ea-5822-4b9d-880d-ba6d1ba87a62 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:16.026127 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-76a2a5ea-5822-4b9d-880d-ba6d1ba87a62 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:16.033780 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-76a2a5ea-5822-4b9d-880d-ba6d1ba87a62 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3" status: 200 len: 1367 microversion: 2.1 time: 0.158649 Aug 31 01:26:16.034355 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 239/478] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:15 2022] GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:26:16.051701 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-ae8af19d-1a8a-4529-967a-1e2499a93866 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "POST /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1/action" status: 202 len: 0 microversion: 2.1 time: 0.238207 Aug 31 01:26:16.052382 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 240/479] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 31 01:26:15 2022] POST /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 01:26:16.060614 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-a1b3d230-8e0a-4bda-9609-94a4433e50d4 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:16.061256 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-a1b3d230-8e0a-4bda-9609-94a4433e50d4 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:16.067229 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a1b3d230-8e0a-4bda-9609-94a4433e50d4 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:16.067718 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a1b3d230-8e0a-4bda-9609-94a4433e50d4 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:16.068155 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a1b3d230-8e0a-4bda-9609-94a4433e50d4 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:16.068875 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a1b3d230-8e0a-4bda-9609-94a4433e50d4 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:16.069327 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a1b3d230-8e0a-4bda-9609-94a4433e50d4 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:16.069749 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a1b3d230-8e0a-4bda-9609-94a4433e50d4 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:16.207940 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-a1b3d230-8e0a-4bda-9609-94a4433e50d4 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:16.217739 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-a1b3d230-8e0a-4bda-9609-94a4433e50d4 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1725 microversion: 2.1 time: 0.160997 Aug 31 01:26:16.218703 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 240/480] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:16 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:26:17.056362 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-b7cc4b9c-e5e4-4e36-9ba3-133111fb2a0e tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:17.057084 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-b7cc4b9c-e5e4-4e36-9ba3-133111fb2a0e tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: acd1b630-d842-47ea-8019-f405c41ad7d3] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:17.063675 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b7cc4b9c-e5e4-4e36-9ba3-133111fb2a0e tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:17.064156 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b7cc4b9c-e5e4-4e36-9ba3-133111fb2a0e tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:17.064591 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b7cc4b9c-e5e4-4e36-9ba3-133111fb2a0e tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:17.065306 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b7cc4b9c-e5e4-4e36-9ba3-133111fb2a0e tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:17.065760 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b7cc4b9c-e5e4-4e36-9ba3-133111fb2a0e tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:17.066176 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b7cc4b9c-e5e4-4e36-9ba3-133111fb2a0e tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:17.240050 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-fdfcc516-69ae-4b7a-93fd-b4d1d1923a4e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:17.240690 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-fdfcc516-69ae-4b7a-93fd-b4d1d1923a4e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:17.248181 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fdfcc516-69ae-4b7a-93fd-b4d1d1923a4e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:17.248772 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fdfcc516-69ae-4b7a-93fd-b4d1d1923a4e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:17.249213 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fdfcc516-69ae-4b7a-93fd-b4d1d1923a4e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:17.249908 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fdfcc516-69ae-4b7a-93fd-b4d1d1923a4e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:17.250362 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fdfcc516-69ae-4b7a-93fd-b4d1d1923a4e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:17.250785 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fdfcc516-69ae-4b7a-93fd-b4d1d1923a4e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:17.271945 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-b7cc4b9c-e5e4-4e36-9ba3-133111fb2a0e tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:17.279557 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-b7cc4b9c-e5e4-4e36-9ba3-133111fb2a0e tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3" status: 200 len: 1367 microversion: 2.1 time: 0.227890 Aug 31 01:26:17.280457 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 241/481] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:17 2022] GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3 => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:26:17.385526 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-fdfcc516-69ae-4b7a-93fd-b4d1d1923a4e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:17.393719 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-fdfcc516-69ae-4b7a-93fd-b4d1d1923a4e tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1725 microversion: 2.1 time: 0.157593 Aug 31 01:26:17.399910 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 241/482] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:17 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:26:18.300830 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-6c734b01-569f-4cd7-8bd9-3818e7cf6a64 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:18.301576 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-6c734b01-569f-4cd7-8bd9-3818e7cf6a64 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: acd1b630-d842-47ea-8019-f405c41ad7d3] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:18.308109 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6c734b01-569f-4cd7-8bd9-3818e7cf6a64 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:18.308590 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6c734b01-569f-4cd7-8bd9-3818e7cf6a64 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:18.309060 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6c734b01-569f-4cd7-8bd9-3818e7cf6a64 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:18.309755 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6c734b01-569f-4cd7-8bd9-3818e7cf6a64 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:18.310209 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6c734b01-569f-4cd7-8bd9-3818e7cf6a64 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:18.310634 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6c734b01-569f-4cd7-8bd9-3818e7cf6a64 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:18.414471 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-69805476-c0c7-4b00-b086-a138b092ca64 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:18.415827 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-69805476-c0c7-4b00-b086-a138b092ca64 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:18.422320 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-69805476-c0c7-4b00-b086-a138b092ca64 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:18.422867 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-69805476-c0c7-4b00-b086-a138b092ca64 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:18.423314 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-69805476-c0c7-4b00-b086-a138b092ca64 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:18.423976 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-69805476-c0c7-4b00-b086-a138b092ca64 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:18.424429 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-69805476-c0c7-4b00-b086-a138b092ca64 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:18.424880 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-69805476-c0c7-4b00-b086-a138b092ca64 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:18.439552 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-6c734b01-569f-4cd7-8bd9-3818e7cf6a64 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:18.447123 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-6c734b01-569f-4cd7-8bd9-3818e7cf6a64 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3" status: 200 len: 1367 microversion: 2.1 time: 0.150129 Aug 31 01:26:18.447687 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 242/483] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:18 2022] GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:26:18.557326 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-69805476-c0c7-4b00-b086-a138b092ca64 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:18.565556 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-69805476-c0c7-4b00-b086-a138b092ca64 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1725 microversion: 2.1 time: 0.154969 Aug 31 01:26:18.566118 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 242/484] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:18 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:26:19.467522 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-ac8875d0-def7-4ba0-a9c2-2ce06511fa7d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:19.468118 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-ac8875d0-def7-4ba0-a9c2-2ce06511fa7d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: acd1b630-d842-47ea-8019-f405c41ad7d3] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:19.474521 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ac8875d0-def7-4ba0-a9c2-2ce06511fa7d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:19.475002 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ac8875d0-def7-4ba0-a9c2-2ce06511fa7d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:19.475434 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ac8875d0-def7-4ba0-a9c2-2ce06511fa7d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:19.476121 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ac8875d0-def7-4ba0-a9c2-2ce06511fa7d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:19.476569 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ac8875d0-def7-4ba0-a9c2-2ce06511fa7d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:19.477021 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ac8875d0-def7-4ba0-a9c2-2ce06511fa7d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:19.586299 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-30efa7d6-e197-4059-9cf4-8b5393b88e2f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:19.586945 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-30efa7d6-e197-4059-9cf4-8b5393b88e2f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:19.593599 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-30efa7d6-e197-4059-9cf4-8b5393b88e2f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:19.594083 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-30efa7d6-e197-4059-9cf4-8b5393b88e2f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:19.594512 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-30efa7d6-e197-4059-9cf4-8b5393b88e2f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:19.595198 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-30efa7d6-e197-4059-9cf4-8b5393b88e2f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:19.595647 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-30efa7d6-e197-4059-9cf4-8b5393b88e2f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:19.596063 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-30efa7d6-e197-4059-9cf4-8b5393b88e2f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:19.609367 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-ac8875d0-def7-4ba0-a9c2-2ce06511fa7d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:19.622971 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-ac8875d0-def7-4ba0-a9c2-2ce06511fa7d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3" status: 200 len: 1367 microversion: 2.1 time: 0.159165 Aug 31 01:26:19.623676 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 243/485] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:19 2022] GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:26:19.733566 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-30efa7d6-e197-4059-9cf4-8b5393b88e2f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:19.741672 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-30efa7d6-e197-4059-9cf4-8b5393b88e2f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1725 microversion: 2.1 time: 0.159186 Aug 31 01:26:19.742230 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 243/486] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:19 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:26:20.643841 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-cc2fbc8f-b9e4-4860-84c0-18ff2252a121 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:20.644439 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-cc2fbc8f-b9e4-4860-84c0-18ff2252a121 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: acd1b630-d842-47ea-8019-f405c41ad7d3] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:20.650835 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cc2fbc8f-b9e4-4860-84c0-18ff2252a121 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:20.651309 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cc2fbc8f-b9e4-4860-84c0-18ff2252a121 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:20.651733 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cc2fbc8f-b9e4-4860-84c0-18ff2252a121 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:20.652416 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cc2fbc8f-b9e4-4860-84c0-18ff2252a121 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:20.652896 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cc2fbc8f-b9e4-4860-84c0-18ff2252a121 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:20.653307 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cc2fbc8f-b9e4-4860-84c0-18ff2252a121 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:20.763714 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-3208feaa-f83e-4363-8e77-b0046827d393 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:20.764326 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-3208feaa-f83e-4363-8e77-b0046827d393 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:20.770975 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3208feaa-f83e-4363-8e77-b0046827d393 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:20.771517 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3208feaa-f83e-4363-8e77-b0046827d393 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:20.771953 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3208feaa-f83e-4363-8e77-b0046827d393 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:20.772698 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3208feaa-f83e-4363-8e77-b0046827d393 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:20.773192 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3208feaa-f83e-4363-8e77-b0046827d393 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:20.773640 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3208feaa-f83e-4363-8e77-b0046827d393 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:20.780072 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-cc2fbc8f-b9e4-4860-84c0-18ff2252a121 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:20.787689 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-cc2fbc8f-b9e4-4860-84c0-18ff2252a121 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3" status: 200 len: 1556 microversion: 2.1 time: 0.148022 Aug 31 01:26:20.788458 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 244/487] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:20 2022] GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3 => generated 1556 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:26:20.808022 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-57a95a24-eec1-48e9-af09-eb5fb83ef078 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:20.808511 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-57a95a24-eec1-48e9-af09-eb5fb83ef078 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: acd1b630-d842-47ea-8019-f405c41ad7d3] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:20.814414 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-57a95a24-eec1-48e9-af09-eb5fb83ef078 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:20.814897 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-57a95a24-eec1-48e9-af09-eb5fb83ef078 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:20.815330 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-57a95a24-eec1-48e9-af09-eb5fb83ef078 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:20.816021 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-57a95a24-eec1-48e9-af09-eb5fb83ef078 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:20.816470 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-57a95a24-eec1-48e9-af09-eb5fb83ef078 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:20.816925 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-57a95a24-eec1-48e9-af09-eb5fb83ef078 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:20.918273 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-57a95a24-eec1-48e9-af09-eb5fb83ef078 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.113414 Aug 31 01:26:20.918273 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 245/488] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Aug 31 01:26:20 2022] GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3/os-interface => generated 284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:26:20.939486 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-3208feaa-f83e-4363-8e77-b0046827d393 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:20.948318 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-3208feaa-f83e-4363-8e77-b0046827d393 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1731 microversion: 2.1 time: 0.189094 Aug 31 01:26:20.948923 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 244/489] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:20 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1731 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:26:20.968874 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-b13446c0-2aeb-48d4-8a3b-eb73638515ac tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:20.969278 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-b13446c0-2aeb-48d4-8a3b-eb73638515ac tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:20.975362 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b13446c0-2aeb-48d4-8a3b-eb73638515ac tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:20.975851 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b13446c0-2aeb-48d4-8a3b-eb73638515ac tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:20.976320 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b13446c0-2aeb-48d4-8a3b-eb73638515ac tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:20.977059 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b13446c0-2aeb-48d4-8a3b-eb73638515ac tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:20.977514 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b13446c0-2aeb-48d4-8a3b-eb73638515ac tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:20.977936 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b13446c0-2aeb-48d4-8a3b-eb73638515ac tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:21.055537 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-b13446c0-2aeb-48d4-8a3b-eb73638515ac tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090651 Aug 31 01:26:21.056359 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 246/490] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Aug 31 01:26:20 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:26:22.007851 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-fcd30273-7f8e-4f28-b2ec-8850345967f7 req-8ac26a60-e057-4744-9947-fe9cf9286df6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "380077d1-0ed7-47ac-9e19-5425164e6da1", "tag": "6715d43f-3649-46e9-b421-5ed74efa38b9"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:26:22.017513 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-fcd30273-7f8e-4f28-b2ec-8850345967f7 req-8ac26a60-e057-4744-9947-fe9cf9286df6 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:22.018353 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-fcd30273-7f8e-4f28-b2ec-8850345967f7 req-8ac26a60-e057-4744-9947-fe9cf9286df6 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:22.019045 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-fcd30273-7f8e-4f28-b2ec-8850345967f7 req-8ac26a60-e057-4744-9947-fe9cf9286df6 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:22.033732 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-fcd30273-7f8e-4f28-b2ec-8850345967f7 req-8ac26a60-e057-4744-9947-fe9cf9286df6 service nova] Creating event network-changed:6715d43f-3649-46e9-b421-5ed74efa38b9 for instance 380077d1-0ed7-47ac-9e19-5425164e6da1 on hv-cinder-85528 Aug 31 01:26:22.038806 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-fcd30273-7f8e-4f28-b2ec-8850345967f7 req-8ac26a60-e057-4744-9947-fe9cf9286df6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034666 Aug 31 01:26:22.039410 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 245/491] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:26:22.158352 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [req-be45d106-89d1-4e7d-9e57-338f458fc10b req-04d1e7d7-b72b-4eb9-badf-d72ef22c2b37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acd1b630-d842-47ea-8019-f405c41ad7d3", "tag": "56319e02-73a5-4ec7-acf3-90f2592a466e"}]} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:26:22.169420 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-be45d106-89d1-4e7d-9e57-338f458fc10b req-04d1e7d7-b72b-4eb9-badf-d72ef22c2b37 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:22.170002 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-be45d106-89d1-4e7d-9e57-338f458fc10b req-04d1e7d7-b72b-4eb9-badf-d72ef22c2b37 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:22.170571 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-be45d106-89d1-4e7d-9e57-338f458fc10b req-04d1e7d7-b72b-4eb9-badf-d72ef22c2b37 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:22.182325 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.compute.server_external_events [req-be45d106-89d1-4e7d-9e57-338f458fc10b req-04d1e7d7-b72b-4eb9-badf-d72ef22c2b37 service nova] Creating event network-changed:56319e02-73a5-4ec7-acf3-90f2592a466e for instance acd1b630-d842-47ea-8019-f405c41ad7d3 on hv-cinder-85528 Aug 31 01:26:22.188089 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [req-be45d106-89d1-4e7d-9e57-338f458fc10b req-04d1e7d7-b72b-4eb9-badf-d72ef22c2b37 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037836 Aug 31 01:26:22.192250 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 247/492] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:26:24.055487 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-3e7f60a8-d8b3-41e5-916e-397b7bf41032 req-4ae8a12d-a83d-4702-b78d-538812387666 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "380077d1-0ed7-47ac-9e19-5425164e6da1", "tag": "6715d43f-3649-46e9-b421-5ed74efa38b9"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:26:24.064993 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-3e7f60a8-d8b3-41e5-916e-397b7bf41032 req-4ae8a12d-a83d-4702-b78d-538812387666 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:24.065508 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-3e7f60a8-d8b3-41e5-916e-397b7bf41032 req-4ae8a12d-a83d-4702-b78d-538812387666 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:24.065945 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-3e7f60a8-d8b3-41e5-916e-397b7bf41032 req-4ae8a12d-a83d-4702-b78d-538812387666 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:24.077012 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-3e7f60a8-d8b3-41e5-916e-397b7bf41032 req-4ae8a12d-a83d-4702-b78d-538812387666 service nova] Creating event network-changed:6715d43f-3649-46e9-b421-5ed74efa38b9 for instance 380077d1-0ed7-47ac-9e19-5425164e6da1 on hv-cinder-85528 Aug 31 01:26:24.081950 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-3e7f60a8-d8b3-41e5-916e-397b7bf41032 req-4ae8a12d-a83d-4702-b78d-538812387666 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030974 Aug 31 01:26:24.082487 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 246/493] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:26:35.569042 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-30dd3e40-5438-4b76-bef4-b1e373503302 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:35.569616 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-30dd3e40-5438-4b76-bef4-b1e373503302 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:35.572238 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:26:35.572895 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:26:35.578937 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-30dd3e40-5438-4b76-bef4-b1e373503302 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:35.581529 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-30dd3e40-5438-4b76-bef4-b1e373503302 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:35.581529 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-30dd3e40-5438-4b76-bef4-b1e373503302 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:35.581529 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-30dd3e40-5438-4b76-bef4-b1e373503302 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:35.581529 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-30dd3e40-5438-4b76-bef4-b1e373503302 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:35.582001 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-30dd3e40-5438-4b76-bef4-b1e373503302 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:35.708243 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.objects.instance [None req-30dd3e40-5438-4b76-bef4-b1e373503302 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lazy-loading 'services' on Instance uuid 368bac0a-39c9-4f1e-99f9-84223e7de06b {{(pid=121026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:26:35.952410 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-30dd3e40-5438-4b76-bef4-b1e373503302 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "DELETE /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b/os-volume_attachments/c5c363c8-7ed0-4662-bdc2-727063f7467f" status: 202 len: 0 microversion: 2.1 time: 0.387505 Aug 31 01:26:35.953031 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 248/494] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 31 01:26:35 2022] DELETE /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b/os-volume_attachments/c5c363c8-7ed0-4662-bdc2-727063f7467f => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 01:26:38.122039 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:26:38.122889 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell1:SELECT=49 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:26:38.126971 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-e094366b-9dba-4f7e-993b-801b60b2c189 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:26:38.132986 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e094366b-9dba-4f7e-993b-801b60b2c189 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:38.140966 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e094366b-9dba-4f7e-993b-801b60b2c189 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:38.140966 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e094366b-9dba-4f7e-993b-801b60b2c189 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:38.156058 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-e094366b-9dba-4f7e-993b-801b60b2c189 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Going to try to stop instance {{(pid=121025) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 01:26:38.378293 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-e094366b-9dba-4f7e-993b-801b60b2c189 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "POST /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b/action" status: 202 len: 0 microversion: 2.1 time: 0.258183 Aug 31 01:26:38.379210 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 247/495] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 31 01:26:38 2022] POST /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 01:26:38.388249 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-8b9b9cbd-a6c0-4870-84fd-7e5b211e8ffc tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:38.388994 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-8b9b9cbd-a6c0-4870-84fd-7e5b211e8ffc tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:38.395063 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8b9b9cbd-a6c0-4870-84fd-7e5b211e8ffc tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:38.395624 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8b9b9cbd-a6c0-4870-84fd-7e5b211e8ffc tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:38.396025 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8b9b9cbd-a6c0-4870-84fd-7e5b211e8ffc tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:38.396711 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8b9b9cbd-a6c0-4870-84fd-7e5b211e8ffc tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:38.397187 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8b9b9cbd-a6c0-4870-84fd-7e5b211e8ffc tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:38.397650 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8b9b9cbd-a6c0-4870-84fd-7e5b211e8ffc tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:38.531770 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-8b9b9cbd-a6c0-4870-84fd-7e5b211e8ffc tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:38.539596 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-8b9b9cbd-a6c0-4870-84fd-7e5b211e8ffc tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1678 microversion: 2.1 time: 0.156084 Aug 31 01:26:38.540170 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 249/496] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:38 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:26:38.753402 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-0749cb48-a264-4fe5-8812-16c2a39f170b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:38.753896 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-0749cb48-a264-4fe5-8812-16c2a39f170b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:38.760010 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0749cb48-a264-4fe5-8812-16c2a39f170b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:38.760487 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0749cb48-a264-4fe5-8812-16c2a39f170b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:38.760949 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0749cb48-a264-4fe5-8812-16c2a39f170b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:38.761632 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0749cb48-a264-4fe5-8812-16c2a39f170b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:38.762083 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0749cb48-a264-4fe5-8812-16c2a39f170b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:38.762501 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0749cb48-a264-4fe5-8812-16c2a39f170b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:38.791663 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-0749cb48-a264-4fe5-8812-16c2a39f170b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5/os-volume_attachments/042bc048-0582-4108-9296-b7d6cd72dd9c" status: 200 len: 194 microversion: 2.20 time: 0.042801 Aug 31 01:26:38.792254 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 248/497] 10.222.0.20 () {60 vars in 1454 bytes} [Wed Aug 31 01:26:38 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5/os-volume_attachments/042bc048-0582-4108-9296-b7d6cd72dd9c => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 01:26:38.860742 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-255638b7-6ad7-4f88-b907-d6fa21d67442 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:38.861243 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-255638b7-6ad7-4f88-b907-d6fa21d67442 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:38.867166 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-255638b7-6ad7-4f88-b907-d6fa21d67442 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:38.867654 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-255638b7-6ad7-4f88-b907-d6fa21d67442 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:38.868088 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-255638b7-6ad7-4f88-b907-d6fa21d67442 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:38.868812 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-255638b7-6ad7-4f88-b907-d6fa21d67442 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:38.869271 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-255638b7-6ad7-4f88-b907-d6fa21d67442 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:38.869693 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-255638b7-6ad7-4f88-b907-d6fa21d67442 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:38.952451 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.objects.instance [None req-255638b7-6ad7-4f88-b907-d6fa21d67442 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lazy-loading 'services' on Instance uuid 12814f73-696a-4dc2-9182-7779bfe90ad5 {{(pid=121026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:26:39.163065 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-255638b7-6ad7-4f88-b907-d6fa21d67442 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "DELETE /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5/os-volume_attachments/042bc048-0582-4108-9296-b7d6cd72dd9c" status: 202 len: 0 microversion: 2.20 time: 0.307023 Aug 31 01:26:39.163697 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 250/498] 10.222.0.20 () {60 vars in 1457 bytes} [Wed Aug 31 01:26:38 2022] DELETE /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5/os-volume_attachments/042bc048-0582-4108-9296-b7d6cd72dd9c => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 01:26:39.172299 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-a8ab0f68-9632-4fe5-9fed-c957ee2c95a0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:39.175109 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-a8ab0f68-9632-4fe5-9fed-c957ee2c95a0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:39.181691 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a8ab0f68-9632-4fe5-9fed-c957ee2c95a0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:39.185806 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a8ab0f68-9632-4fe5-9fed-c957ee2c95a0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:39.185806 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a8ab0f68-9632-4fe5-9fed-c957ee2c95a0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:39.185806 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a8ab0f68-9632-4fe5-9fed-c957ee2c95a0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:39.185806 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a8ab0f68-9632-4fe5-9fed-c957ee2c95a0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:39.186198 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a8ab0f68-9632-4fe5-9fed-c957ee2c95a0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:39.215595 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-a8ab0f68-9632-4fe5-9fed-c957ee2c95a0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046851 Aug 31 01:26:39.216169 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 249/499] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 31 01:26:39 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 01:26:39.562743 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-8bbc86bd-6c0d-4f5f-9e13-867b886d64ae tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:39.563355 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-8bbc86bd-6c0d-4f5f-9e13-867b886d64ae tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:39.569369 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8bbc86bd-6c0d-4f5f-9e13-867b886d64ae tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:39.569838 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8bbc86bd-6c0d-4f5f-9e13-867b886d64ae tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:39.570264 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8bbc86bd-6c0d-4f5f-9e13-867b886d64ae tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:39.570933 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8bbc86bd-6c0d-4f5f-9e13-867b886d64ae tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:39.571382 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8bbc86bd-6c0d-4f5f-9e13-867b886d64ae tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:39.571793 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8bbc86bd-6c0d-4f5f-9e13-867b886d64ae tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:39.703545 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-8bbc86bd-6c0d-4f5f-9e13-867b886d64ae tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:39.711709 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-8bbc86bd-6c0d-4f5f-9e13-867b886d64ae tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1678 microversion: 2.1 time: 0.154155 Aug 31 01:26:39.712269 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 251/500] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:39 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:26:40.227353 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-fbf55c40-77d2-417a-891c-0d03da80e460 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:40.229508 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-fbf55c40-77d2-417a-891c-0d03da80e460 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:40.235572 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fbf55c40-77d2-417a-891c-0d03da80e460 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:40.236096 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fbf55c40-77d2-417a-891c-0d03da80e460 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:40.236518 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fbf55c40-77d2-417a-891c-0d03da80e460 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:40.237219 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fbf55c40-77d2-417a-891c-0d03da80e460 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:40.237662 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fbf55c40-77d2-417a-891c-0d03da80e460 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:40.238106 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fbf55c40-77d2-417a-891c-0d03da80e460 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:40.268038 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-fbf55c40-77d2-417a-891c-0d03da80e460 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044678 Aug 31 01:26:40.268592 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 250/501] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 31 01:26:40 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 01:26:40.733917 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-2214b147-0015-40a5-b468-d7c89f5aa5a4 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:40.734522 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-2214b147-0015-40a5-b468-d7c89f5aa5a4 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:40.740409 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-2214b147-0015-40a5-b468-d7c89f5aa5a4 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:40.740922 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-2214b147-0015-40a5-b468-d7c89f5aa5a4 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:40.741385 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-2214b147-0015-40a5-b468-d7c89f5aa5a4 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:40.742064 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-2214b147-0015-40a5-b468-d7c89f5aa5a4 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:40.742514 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-2214b147-0015-40a5-b468-d7c89f5aa5a4 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:40.742930 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-2214b147-0015-40a5-b468-d7c89f5aa5a4 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:40.867667 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-2214b147-0015-40a5-b468-d7c89f5aa5a4 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:40.875159 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-2214b147-0015-40a5-b468-d7c89f5aa5a4 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1678 microversion: 2.1 time: 0.145822 Aug 31 01:26:40.875723 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 252/502] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:40 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1678 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:26:41.280252 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-c5b5114e-f821-4cd1-a942-a97771b544b7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:41.282542 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-c5b5114e-f821-4cd1-a942-a97771b544b7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:41.289227 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c5b5114e-f821-4cd1-a942-a97771b544b7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:41.289708 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c5b5114e-f821-4cd1-a942-a97771b544b7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:41.290138 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c5b5114e-f821-4cd1-a942-a97771b544b7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:41.290826 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c5b5114e-f821-4cd1-a942-a97771b544b7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:41.291275 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c5b5114e-f821-4cd1-a942-a97771b544b7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:41.291698 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c5b5114e-f821-4cd1-a942-a97771b544b7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:41.319638 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-c5b5114e-f821-4cd1-a942-a97771b544b7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044021 Aug 31 01:26:41.320182 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 251/503] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 31 01:26:41 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:26:41.380575 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-731e737a-a2f2-48f5-a8ba-0aa150be7686 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:41.381124 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-731e737a-a2f2-48f5-a8ba-0aa150be7686 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:41.387036 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-731e737a-a2f2-48f5-a8ba-0aa150be7686 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:41.387516 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-731e737a-a2f2-48f5-a8ba-0aa150be7686 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:41.387945 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-731e737a-a2f2-48f5-a8ba-0aa150be7686 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:41.388624 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-731e737a-a2f2-48f5-a8ba-0aa150be7686 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:41.389598 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-731e737a-a2f2-48f5-a8ba-0aa150be7686 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:41.390047 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-731e737a-a2f2-48f5-a8ba-0aa150be7686 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:41.416812 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-731e737a-a2f2-48f5-a8ba-0aa150be7686 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Going to try to terminate instance {{(pid=121026) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 01:26:41.689448 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-731e737a-a2f2-48f5-a8ba-0aa150be7686 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "DELETE /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 204 len: 0 microversion: 2.20 time: 0.312340 Aug 31 01:26:41.690044 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 253/504] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Aug 31 01:26:41 2022] DELETE /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 01:26:41.698351 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-f1a37e19-616a-461d-b33d-b665d6c968e7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:41.699117 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-f1a37e19-616a-461d-b33d-b665d6c968e7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:41.706029 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f1a37e19-616a-461d-b33d-b665d6c968e7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:41.706512 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f1a37e19-616a-461d-b33d-b665d6c968e7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:41.706944 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f1a37e19-616a-461d-b33d-b665d6c968e7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:41.707628 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f1a37e19-616a-461d-b33d-b665d6c968e7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:41.708076 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f1a37e19-616a-461d-b33d-b665d6c968e7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:41.708497 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f1a37e19-616a-461d-b33d-b665d6c968e7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:41.840085 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-f1a37e19-616a-461d-b33d-b665d6c968e7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:41.848059 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-f1a37e19-616a-461d-b33d-b665d6c968e7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:41.849559 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-f1a37e19-616a-461d-b33d-b665d6c968e7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:41.850716 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-f1a37e19-616a-461d-b33d-b665d6c968e7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1725 microversion: 2.20 time: 0.156275 Aug 31 01:26:41.851331 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 252/505] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:26:41 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:26:41.896494 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-2b423b1f-7528-4d50-92e2-ab1e27399223 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:41.897216 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-2b423b1f-7528-4d50-92e2-ab1e27399223 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:41.903564 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-2b423b1f-7528-4d50-92e2-ab1e27399223 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:41.904044 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-2b423b1f-7528-4d50-92e2-ab1e27399223 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:41.904477 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-2b423b1f-7528-4d50-92e2-ab1e27399223 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:41.905195 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-2b423b1f-7528-4d50-92e2-ab1e27399223 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:41.905645 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-2b423b1f-7528-4d50-92e2-ab1e27399223 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:41.906065 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-2b423b1f-7528-4d50-92e2-ab1e27399223 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:42.032698 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-2b423b1f-7528-4d50-92e2-ab1e27399223 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:42.040427 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-2b423b1f-7528-4d50-92e2-ab1e27399223 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1678 microversion: 2.1 time: 0.148538 Aug 31 01:26:42.041022 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 254/506] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:41 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:26:42.874241 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-787758ca-ae36-4905-a5a4-eac31c32ddef tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:42.874853 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-787758ca-ae36-4905-a5a4-eac31c32ddef tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:42.881343 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-787758ca-ae36-4905-a5a4-eac31c32ddef tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:42.881825 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-787758ca-ae36-4905-a5a4-eac31c32ddef tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:42.882257 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-787758ca-ae36-4905-a5a4-eac31c32ddef tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:42.882945 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-787758ca-ae36-4905-a5a4-eac31c32ddef tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:42.883396 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-787758ca-ae36-4905-a5a4-eac31c32ddef tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:42.883816 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-787758ca-ae36-4905-a5a4-eac31c32ddef tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:43.013590 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-787758ca-ae36-4905-a5a4-eac31c32ddef tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:43.022176 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-787758ca-ae36-4905-a5a4-eac31c32ddef tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:43.023602 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-787758ca-ae36-4905-a5a4-eac31c32ddef tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:43.024800 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-787758ca-ae36-4905-a5a4-eac31c32ddef tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1725 microversion: 2.20 time: 0.154506 Aug 31 01:26:43.025362 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 253/507] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:26:42 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:26:43.062527 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-7fbb10f4-f8f3-4f57-85e1-67c7df34b2fa tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:43.063064 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-7fbb10f4-f8f3-4f57-85e1-67c7df34b2fa tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:43.069364 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7fbb10f4-f8f3-4f57-85e1-67c7df34b2fa tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:43.069843 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7fbb10f4-f8f3-4f57-85e1-67c7df34b2fa tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:43.070274 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7fbb10f4-f8f3-4f57-85e1-67c7df34b2fa tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:43.070955 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7fbb10f4-f8f3-4f57-85e1-67c7df34b2fa tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:43.071405 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7fbb10f4-f8f3-4f57-85e1-67c7df34b2fa tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:43.071822 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7fbb10f4-f8f3-4f57-85e1-67c7df34b2fa tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:43.198803 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-7fbb10f4-f8f3-4f57-85e1-67c7df34b2fa tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:43.207333 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-7fbb10f4-f8f3-4f57-85e1-67c7df34b2fa tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1678 microversion: 2.1 time: 0.149122 Aug 31 01:26:43.213650 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 255/508] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:43 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:26:44.048189 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-8585aa6f-4dc1-4565-946d-51d2fbff9809 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:44.048838 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-8585aa6f-4dc1-4565-946d-51d2fbff9809 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:44.055194 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8585aa6f-4dc1-4565-946d-51d2fbff9809 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:44.055670 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8585aa6f-4dc1-4565-946d-51d2fbff9809 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:44.056103 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8585aa6f-4dc1-4565-946d-51d2fbff9809 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:44.056825 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8585aa6f-4dc1-4565-946d-51d2fbff9809 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:44.057274 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8585aa6f-4dc1-4565-946d-51d2fbff9809 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:44.057695 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8585aa6f-4dc1-4565-946d-51d2fbff9809 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:44.191665 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-8585aa6f-4dc1-4565-946d-51d2fbff9809 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:44.207204 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-8585aa6f-4dc1-4565-946d-51d2fbff9809 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:44.208871 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-8585aa6f-4dc1-4565-946d-51d2fbff9809 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:44.210037 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-8585aa6f-4dc1-4565-946d-51d2fbff9809 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1725 microversion: 2.20 time: 0.166459 Aug 31 01:26:44.210602 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 254/509] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:26:44 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:26:44.227675 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-75db347f-5778-4127-b53d-525482646b88 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:44.228312 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-75db347f-5778-4127-b53d-525482646b88 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:44.234702 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-75db347f-5778-4127-b53d-525482646b88 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:44.235189 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-75db347f-5778-4127-b53d-525482646b88 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:44.235626 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-75db347f-5778-4127-b53d-525482646b88 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:44.236453 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-75db347f-5778-4127-b53d-525482646b88 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:44.236941 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-75db347f-5778-4127-b53d-525482646b88 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:44.237364 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-75db347f-5778-4127-b53d-525482646b88 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:44.370667 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-75db347f-5778-4127-b53d-525482646b88 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:44.392570 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-75db347f-5778-4127-b53d-525482646b88 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1678 microversion: 2.1 time: 0.166955 Aug 31 01:26:44.392570 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 256/510] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:44 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:26:44.654886 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-06528387-2cf0-4e37-962f-5a1ac25fd991 req-44e9528d-c5d1-41c7-9851-2840b3bf3958 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12814f73-696a-4dc2-9182-7779bfe90ad5", "name": "network-vif-deleted", "tag": "dc60a507-f9d6-4b68-ae6c-65c2cfafb12c"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:26:44.663877 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-06528387-2cf0-4e37-962f-5a1ac25fd991 req-44e9528d-c5d1-41c7-9851-2840b3bf3958 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:44.667504 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-06528387-2cf0-4e37-962f-5a1ac25fd991 req-44e9528d-c5d1-41c7-9851-2840b3bf3958 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:44.667504 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-06528387-2cf0-4e37-962f-5a1ac25fd991 req-44e9528d-c5d1-41c7-9851-2840b3bf3958 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:44.676480 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-06528387-2cf0-4e37-962f-5a1ac25fd991 req-44e9528d-c5d1-41c7-9851-2840b3bf3958 service nova] Creating event network-vif-deleted:dc60a507-f9d6-4b68-ae6c-65c2cfafb12c for instance 12814f73-696a-4dc2-9182-7779bfe90ad5 on hv-cinder-85528 Aug 31 01:26:44.681460 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-06528387-2cf0-4e37-962f-5a1ac25fd991 req-44e9528d-c5d1-41c7-9851-2840b3bf3958 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030840 Aug 31 01:26:44.682058 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 255/511] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:26:45.233561 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-03128daa-aba8-4488-b418-25edca27fc60 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:45.234349 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-03128daa-aba8-4488-b418-25edca27fc60 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:45.241096 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-03128daa-aba8-4488-b418-25edca27fc60 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:45.241650 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-03128daa-aba8-4488-b418-25edca27fc60 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:45.242257 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-03128daa-aba8-4488-b418-25edca27fc60 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:45.243026 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-03128daa-aba8-4488-b418-25edca27fc60 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:45.243594 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-03128daa-aba8-4488-b418-25edca27fc60 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:45.244082 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-03128daa-aba8-4488-b418-25edca27fc60 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:45.276498 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-03128daa-aba8-4488-b418-25edca27fc60 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:45.277020 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-03128daa-aba8-4488-b418-25edca27fc60 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:45.277467 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-03128daa-aba8-4488-b418-25edca27fc60 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:45.277983 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.objects.instance [None req-03128daa-aba8-4488-b418-25edca27fc60 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lazy-loading 'fault' on Instance uuid 12814f73-696a-4dc2-9182-7779bfe90ad5 {{(pid=121026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:26:45.329474 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-03128daa-aba8-4488-b418-25edca27fc60 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:45.337897 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-03128daa-aba8-4488-b418-25edca27fc60 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:45.339366 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-03128daa-aba8-4488-b418-25edca27fc60 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:45.340589 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-03128daa-aba8-4488-b418-25edca27fc60 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 200 len: 1372 microversion: 2.20 time: 0.111059 Aug 31 01:26:45.341196 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 257/512] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:26:45 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 1372 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:26:45.413439 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-0474d0e3-0a26-40ab-871f-d68e47434bda tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:45.414238 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-0474d0e3-0a26-40ab-871f-d68e47434bda tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:45.421176 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0474d0e3-0a26-40ab-871f-d68e47434bda tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:45.421662 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0474d0e3-0a26-40ab-871f-d68e47434bda tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:45.422096 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0474d0e3-0a26-40ab-871f-d68e47434bda tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:45.422778 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0474d0e3-0a26-40ab-871f-d68e47434bda tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:45.423230 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0474d0e3-0a26-40ab-871f-d68e47434bda tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:45.423723 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0474d0e3-0a26-40ab-871f-d68e47434bda tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:45.565500 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-0474d0e3-0a26-40ab-871f-d68e47434bda tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:45.573159 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-0474d0e3-0a26-40ab-871f-d68e47434bda tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1678 microversion: 2.1 time: 0.164400 Aug 31 01:26:45.573777 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 256/513] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:45 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:26:46.364277 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-4ec61ed7-9295-400b-99b3-3226408c94e5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:46.364909 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-4ec61ed7-9295-400b-99b3-3226408c94e5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:46.371420 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4ec61ed7-9295-400b-99b3-3226408c94e5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:46.371904 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4ec61ed7-9295-400b-99b3-3226408c94e5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:46.372335 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4ec61ed7-9295-400b-99b3-3226408c94e5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:46.373740 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4ec61ed7-9295-400b-99b3-3226408c94e5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:46.374190 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4ec61ed7-9295-400b-99b3-3226408c94e5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:46.374636 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4ec61ed7-9295-400b-99b3-3226408c94e5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:46.387673 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.wsgi [None req-4ec61ed7-9295-400b-99b3-3226408c94e5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] HTTP exception thrown: Instance 12814f73-696a-4dc2-9182-7779bfe90ad5 could not be found. Aug 31 01:26:46.389358 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-4ec61ed7-9295-400b-99b3-3226408c94e5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Request method failure captured: Aug 31 01:26:46.389358 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: request: GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 HTTP/1.1 Aug 31 01:26:46.389358 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept: application/json Aug 31 01:26:46.389358 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept-Encoding: identity Aug 31 01:26:46.389358 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Connection: close Aug 31 01:26:46.389358 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Length: 0 Aug 31 01:26:46.389358 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Type: application/json Aug 31 01:26:46.389358 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Host: 10.222.0.20 Aug 31 01:26:46.389358 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Openstack-System-Scope: None Aug 31 01:26:46.389358 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: User-Agent: python-urllib3/1.26.12 Aug 31 01:26:46.389358 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Auth-Token: gAAAAABjDrffHmfquHpU5iPLBs8FDqKutfRVUEUxPEzIj0Biqy4NiVdTblyb_LDRMjmFG2KnARTgH9N7iw65iz55bAnno_TG-r0IIyCJrmIG-kh9BBgEXVLL4dd0AsyK4XngDiiyOKQ1ueozOf6oXBeisdXLVvuDqJvQku7RoTCOErpOkdm1MG4 Aug 31 01:26:46.389358 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Id: None Aug 31 01:26:46.389358 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Name: None Aug 31 01:26:46.389358 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Identity-Status: Confirmed Aug 31 01:26:46.389358 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Is-Admin-Project: True Aug 31 01:26:46.389358 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 01:26:46.389358 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Id: default Aug 31 01:26:46.389358 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Name: Default Aug 31 01:26:46.389358 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Id: 53d2295ada114ea3b6b5001c4c197f35 Aug 31 01:26:46.389358 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1916258718 Aug 31 01:26:46.389358 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Role: member,reader Aug 31 01:26:46.389358 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Roles: member,reader Aug 31 01:26:46.390962 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/53d2295ada114ea3b6b5001c4c197f35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_53d2295ada114ea3b6b5001c4c197f35", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/53d2295ada114ea3b6b5001c4c197f35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/53d2295ada114ea3b6b5001c4c197f35"}]}] Aug 31 01:26:46.390962 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1916258718 Aug 31 01:26:46.390962 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Id: 53d2295ada114ea3b6b5001c4c197f35 Aug 31 01:26:46.390962 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1916258718 Aug 31 01:26:46.390962 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User: tempest-AttachVolumeShelveTestJSON-1916258718-project Aug 31 01:26:46.390962 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Id: default Aug 31 01:26:46.390962 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Name: Default Aug 31 01:26:46.390962 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Id: efaf57b6482149ca86a9bba26d7654f2 Aug 31 01:26:46.390962 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1916258718-project Aug 31 01:26:46.390962 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: method: > Aug 31 01:26:46.390962 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: exception: Instance 12814f73-696a-4dc2-9182-7779bfe90ad5 could not be found. Aug 31 01:26:46.390962 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: action_args: {'id': '12814f73-696a-4dc2-9182-7779bfe90ad5'} Aug 31 01:26:46.392044 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:26:46.392044 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:26:46.392044 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:26:46.392044 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:26:46.392044 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:26:46.392044 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:26:46.392044 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:26:46.392044 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:26:46.392044 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:26:46.392044 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:26:46.392044 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12814f73-696a-4dc2-9182-7779bfe90ad5 could not be found. Aug 31 01:26:46.392044 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:26:46.392044 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:26:46.392044 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:26:46.392044 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:26:46.392044 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:26:46.392044 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:26:46.392044 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:26:46.392044 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:26:46.392044 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:26:46.393595 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:26:46.393595 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:26:46.393595 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:26:46.393595 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:26:46.393595 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:26:46.393595 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:26:46.393595 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:26:46.393595 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12814f73-696a-4dc2-9182-7779bfe90ad5 could not be found. Aug 31 01:26:46.393595 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:26:46.393595 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:26:46.393595 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:26:46.393595 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:26:46.393595 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:26:46.393595 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:26:46.393595 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:26:46.393595 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:26:46.393595 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12814f73-696a-4dc2-9182-7779bfe90ad5 could not be found. Aug 31 01:26:46.393595 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:26:46.395104 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-4ec61ed7-9295-400b-99b3-3226408c94e5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Returning 404 to user: Instance 12814f73-696a-4dc2-9182-7779bfe90ad5 could not be found. {{(pid=121026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:26:46.395104 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-4ec61ed7-9295-400b-99b3-3226408c94e5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 404 len: 111 microversion: 2.20 time: 0.030372 Aug 31 01:26:46.395104 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 258/514] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:26:46 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 01:26:46.399515 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-3849ae1a-bf39-4879-9441-9e08e7c22cf8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '.version_select at 0x7f1fe178ab80>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:46.472174 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-3849ae1a-bf39-4879-9441-9e08e7c22cf8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2069606184" status: 204 len: 0 microversion: 2.20 time: 0.076386 Aug 31 01:26:46.472903 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 257/515] 10.222.0.20 () {60 vars in 1262 bytes} [Wed Aug 31 01:26:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2069606184 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 01:26:46.595211 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-5da64830-8f17-4cef-9687-4f729d0ba297 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:46.595829 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-5da64830-8f17-4cef-9687-4f729d0ba297 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:46.601741 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5da64830-8f17-4cef-9687-4f729d0ba297 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:46.602232 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5da64830-8f17-4cef-9687-4f729d0ba297 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:46.602675 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5da64830-8f17-4cef-9687-4f729d0ba297 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:46.603364 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5da64830-8f17-4cef-9687-4f729d0ba297 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:46.603821 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5da64830-8f17-4cef-9687-4f729d0ba297 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:46.604242 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5da64830-8f17-4cef-9687-4f729d0ba297 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:46.748886 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-5da64830-8f17-4cef-9687-4f729d0ba297 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:46.756879 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-5da64830-8f17-4cef-9687-4f729d0ba297 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1678 microversion: 2.1 time: 0.165701 Aug 31 01:26:46.757448 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 259/516] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:46 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:26:47.249224 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-00068e74-4e8b-4a38-8297-b3b26fbf4199 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Action: 'create', calling method: .version_select at 0x7f1fe1847550>, body: {"keypair": {"name": "tempest-keypair-884793689", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEzFGd4rIYoiJToaYftA6Ijbn91U6acXYgHY0NPdPWa+NRjZiVHfz3sXm6sLOWtBAFVCJ41wQUvPtvshhGJiEcVR99Lv+rQyGJO4M+tNyXwBQQyp7mWsyODv6vl++IbfDg=="}} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:26:47.265404 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.quota [None req-00068e74-4e8b-4a38-8297-b3b26fbf4199 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Getting quotas for project 53d2295ada114ea3b6b5001c4c197f35. Resources: {'key_pairs'} {{(pid=121025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 01:26:47.269191 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.quota [None req-00068e74-4e8b-4a38-8297-b3b26fbf4199 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Getting quotas for user efaf57b6482149ca86a9bba26d7654f2 and project 53d2295ada114ea3b6b5001c4c197f35. Resources: {'key_pairs'} {{(pid=121025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 01:26:47.364579 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-00068e74-4e8b-4a38-8297-b3b26fbf4199 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.119400 Aug 31 01:26:47.365208 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 258/517] 10.222.0.20 () {62 vars in 1200 bytes} [Wed Aug 31 01:26:47 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 121 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 01:26:47.778368 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-545ca85f-16b9-47d8-ab5a-2e57536c3c14 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:47.779147 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-545ca85f-16b9-47d8-ab5a-2e57536c3c14 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:47.785630 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-545ca85f-16b9-47d8-ab5a-2e57536c3c14 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:47.786107 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-545ca85f-16b9-47d8-ab5a-2e57536c3c14 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:47.786538 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-545ca85f-16b9-47d8-ab5a-2e57536c3c14 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:47.787220 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-545ca85f-16b9-47d8-ab5a-2e57536c3c14 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:47.787668 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-545ca85f-16b9-47d8-ab5a-2e57536c3c14 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:47.788139 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-545ca85f-16b9-47d8-ab5a-2e57536c3c14 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:47.928746 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-545ca85f-16b9-47d8-ab5a-2e57536c3c14 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:47.936671 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-545ca85f-16b9-47d8-ab5a-2e57536c3c14 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1678 microversion: 2.1 time: 0.162137 Aug 31 01:26:47.937252 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 260/518] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:47 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:26:48.958352 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-67d07fa1-5b43-4a72-9ebf-45334c41ef28 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:48.959026 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-67d07fa1-5b43-4a72-9ebf-45334c41ef28 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:48.965044 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-67d07fa1-5b43-4a72-9ebf-45334c41ef28 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:48.965521 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-67d07fa1-5b43-4a72-9ebf-45334c41ef28 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:48.965952 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-67d07fa1-5b43-4a72-9ebf-45334c41ef28 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:48.967172 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-67d07fa1-5b43-4a72-9ebf-45334c41ef28 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:48.967630 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-67d07fa1-5b43-4a72-9ebf-45334c41ef28 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:48.968050 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-67d07fa1-5b43-4a72-9ebf-45334c41ef28 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:49.097793 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-67d07fa1-5b43-4a72-9ebf-45334c41ef28 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:49.105784 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-67d07fa1-5b43-4a72-9ebf-45334c41ef28 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1655 microversion: 2.1 time: 0.152154 Aug 31 01:26:49.106343 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 259/519] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:48 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1655 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:26:49.126405 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-1586cacf-b7bb-4b96-9638-8aca747e6b5d tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:26:49.132865 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1586cacf-b7bb-4b96-9638-8aca747e6b5d tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:49.133425 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1586cacf-b7bb-4b96-9638-8aca747e6b5d tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:49.133791 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1586cacf-b7bb-4b96-9638-8aca747e6b5d tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:49.156102 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-1586cacf-b7bb-4b96-9638-8aca747e6b5d tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Going to try to start instance {{(pid=121026) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 01:26:49.160523 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:26:49.446975 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-1586cacf-b7bb-4b96-9638-8aca747e6b5d tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "POST /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b/action" status: 202 len: 0 microversion: 2.1 time: 0.324261 Aug 31 01:26:49.447581 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 261/520] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 31 01:26:49 2022] POST /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 01:26:49.468043 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-9aa14c12-ff4b-44bc-8725-bb3a834d3aaf tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:49.469150 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-9aa14c12-ff4b-44bc-8725-bb3a834d3aaf tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:49.476106 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9aa14c12-ff4b-44bc-8725-bb3a834d3aaf tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:49.476592 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9aa14c12-ff4b-44bc-8725-bb3a834d3aaf tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:49.477072 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9aa14c12-ff4b-44bc-8725-bb3a834d3aaf tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:49.477839 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9aa14c12-ff4b-44bc-8725-bb3a834d3aaf tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:49.478290 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9aa14c12-ff4b-44bc-8725-bb3a834d3aaf tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:49.478712 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9aa14c12-ff4b-44bc-8725-bb3a834d3aaf tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:49.548172 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-710ac9c6-9831-4c48-8e3f-5f88a3a3a1af tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-121172869", "imageRef": "ed6d3236-defa-4ccf-90ba-343c0d0ad58e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2a0890c6-f1c3-465a-8b4d-8e1ae2356a58"}], "security_groups": [{"name": "tempest-securitygroup--690696547"}], "key_name": "tempest-keypair-884793689", "user_data": "}} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:26:49.629874 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-9aa14c12-ff4b-44bc-8725-bb3a834d3aaf tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:49.637726 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-9aa14c12-ff4b-44bc-8725-bb3a834d3aaf tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1664 microversion: 2.1 time: 0.179587 Aug 31 01:26:49.639003 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 260/521] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:49 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1664 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:26:49.667762 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.network.neutron [None req-710ac9c6-9831-4c48-8e3f-5f88a3a3a1af tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] validate_networks() for [('2a0890c6-f1c3-465a-8b4d-8e1ae2356a58', None, None, None, None, None)] {{(pid=121026) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 01:26:50.047525 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.virt.hardware [None req-710ac9c6-9831-4c48-8e3f-5f88a3a3a1af tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Flavor limits 0:0:0 {{(pid=121026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 01:26:50.052037 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.virt.hardware [None req-710ac9c6-9831-4c48-8e3f-5f88a3a3a1af tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Image limits 0:0:0 {{(pid=121026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 01:26:50.052037 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.virt.hardware [None req-710ac9c6-9831-4c48-8e3f-5f88a3a3a1af tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Flavor pref 0:0:0 {{(pid=121026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 01:26:50.052037 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.virt.hardware [None req-710ac9c6-9831-4c48-8e3f-5f88a3a3a1af tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Image pref 0:0:0 {{(pid=121026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 01:26:50.052037 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.virt.hardware [None req-710ac9c6-9831-4c48-8e3f-5f88a3a3a1af tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 01:26:50.058400 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-710ac9c6-9831-4c48-8e3f-5f88a3a3a1af tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:50.058881 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-710ac9c6-9831-4c48-8e3f-5f88a3a3a1af tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:50.059319 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-710ac9c6-9831-4c48-8e3f-5f88a3a3a1af tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:50.060049 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-710ac9c6-9831-4c48-8e3f-5f88a3a3a1af tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:50.061019 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-710ac9c6-9831-4c48-8e3f-5f88a3a3a1af tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:50.061464 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-710ac9c6-9831-4c48-8e3f-5f88a3a3a1af tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:50.078624 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.quota [None req-710ac9c6-9831-4c48-8e3f-5f88a3a3a1af tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Getting quotas for project 53d2295ada114ea3b6b5001c4c197f35. Resources: {'instances', 'cores', 'ram'} {{(pid=121026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 01:26:50.083118 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.quota [None req-710ac9c6-9831-4c48-8e3f-5f88a3a3a1af tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Getting quotas for user efaf57b6482149ca86a9bba26d7654f2 and project 53d2295ada114ea3b6b5001c4c197f35. Resources: {'instances', 'cores', 'ram'} {{(pid=121026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 01:26:50.094047 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-710ac9c6-9831-4c48-8e3f-5f88a3a3a1af tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Going to run 1 instances... {{(pid=121026) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 01:26:50.096426 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-710ac9c6-9831-4c48-8e3f-5f88a3a3a1af tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ed6d3236-defa-4ccf-90ba-343c0d0ad58e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121026) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 01:26:50.228926 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-710ac9c6-9831-4c48-8e3f-5f88a3a3a1af tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.685355 Aug 31 01:26:50.229929 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 262/522] 10.222.0.20 () {62 vars in 1188 bytes} [Wed Aug 31 01:26:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 31 01:26:50.240832 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-c2491010-5297-41cb-bc3f-f42c9a29e0a4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:50.242059 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-c2491010-5297-41cb-bc3f-f42c9a29e0a4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:50.296229 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-c2491010-5297-41cb-bc3f-f42c9a29e0a4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:50.303330 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-c2491010-5297-41cb-bc3f-f42c9a29e0a4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:50.304863 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-c2491010-5297-41cb-bc3f-f42c9a29e0a4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:50.305960 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-c2491010-5297-41cb-bc3f-f42c9a29e0a4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1280 microversion: 2.20 time: 0.069030 Aug 31 01:26:50.311088 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 261/523] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:26:50 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1280 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:26:50.659609 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-a0dfc6cd-5e88-4d07-b00e-acecfcd1af12 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:50.660223 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-a0dfc6cd-5e88-4d07-b00e-acecfcd1af12 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:50.667215 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a0dfc6cd-5e88-4d07-b00e-acecfcd1af12 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:50.667702 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a0dfc6cd-5e88-4d07-b00e-acecfcd1af12 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:50.668143 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a0dfc6cd-5e88-4d07-b00e-acecfcd1af12 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:50.668906 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a0dfc6cd-5e88-4d07-b00e-acecfcd1af12 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:50.669435 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a0dfc6cd-5e88-4d07-b00e-acecfcd1af12 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:50.670419 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a0dfc6cd-5e88-4d07-b00e-acecfcd1af12 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:50.801983 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-a0dfc6cd-5e88-4d07-b00e-acecfcd1af12 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:50.810069 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-a0dfc6cd-5e88-4d07-b00e-acecfcd1af12 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1664 microversion: 2.1 time: 0.154487 Aug 31 01:26:50.810636 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 263/524] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:50 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1664 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:26:51.329401 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-39366cdf-c091-4161-9650-218b7ca58254 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:51.329951 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-39366cdf-c091-4161-9650-218b7ca58254 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:51.337042 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-39366cdf-c091-4161-9650-218b7ca58254 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:51.337532 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-39366cdf-c091-4161-9650-218b7ca58254 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:51.337966 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-39366cdf-c091-4161-9650-218b7ca58254 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:51.338662 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-39366cdf-c091-4161-9650-218b7ca58254 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:51.339120 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-39366cdf-c091-4161-9650-218b7ca58254 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:51.339547 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-39366cdf-c091-4161-9650-218b7ca58254 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:51.401232 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-39366cdf-c091-4161-9650-218b7ca58254 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:51.409323 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-39366cdf-c091-4161-9650-218b7ca58254 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:51.410756 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-39366cdf-c091-4161-9650-218b7ca58254 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:51.411865 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-39366cdf-c091-4161-9650-218b7ca58254 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1284 microversion: 2.20 time: 0.087526 Aug 31 01:26:51.412412 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 262/525] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:26:51 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:26:51.831981 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-8133d5ec-d20a-44d4-8d64-10ac7404b5b4 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:51.832617 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-8133d5ec-d20a-44d4-8d64-10ac7404b5b4 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:51.839092 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8133d5ec-d20a-44d4-8d64-10ac7404b5b4 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:51.839574 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8133d5ec-d20a-44d4-8d64-10ac7404b5b4 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:51.840010 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8133d5ec-d20a-44d4-8d64-10ac7404b5b4 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:51.840696 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8133d5ec-d20a-44d4-8d64-10ac7404b5b4 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:51.841181 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8133d5ec-d20a-44d4-8d64-10ac7404b5b4 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:51.841797 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8133d5ec-d20a-44d4-8d64-10ac7404b5b4 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:51.968297 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-8133d5ec-d20a-44d4-8d64-10ac7404b5b4 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:51.976009 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-8133d5ec-d20a-44d4-8d64-10ac7404b5b4 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1668 microversion: 2.1 time: 0.148182 Aug 31 01:26:51.976570 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 264/526] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:26:51 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1668 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:26:52.434106 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-3ed486a3-4eba-4520-8535-98cbba262ee2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:52.434765 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-3ed486a3-4eba-4520-8535-98cbba262ee2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:52.441198 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3ed486a3-4eba-4520-8535-98cbba262ee2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:52.441688 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3ed486a3-4eba-4520-8535-98cbba262ee2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:52.442124 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3ed486a3-4eba-4520-8535-98cbba262ee2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:52.442884 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3ed486a3-4eba-4520-8535-98cbba262ee2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:52.443346 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3ed486a3-4eba-4520-8535-98cbba262ee2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:52.443785 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3ed486a3-4eba-4520-8535-98cbba262ee2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:52.508816 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-3ed486a3-4eba-4520-8535-98cbba262ee2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:52.517594 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-3ed486a3-4eba-4520-8535-98cbba262ee2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:52.519017 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-3ed486a3-4eba-4520-8535-98cbba262ee2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:52.521610 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-3ed486a3-4eba-4520-8535-98cbba262ee2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1340 microversion: 2.20 time: 0.090100 Aug 31 01:26:52.521610 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 263/527] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:26:52 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1340 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:26:53.544964 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-3274a169-0d16-4792-bcfd-1a59ea064d7b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:53.546093 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-3274a169-0d16-4792-bcfd-1a59ea064d7b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:53.552517 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3274a169-0d16-4792-bcfd-1a59ea064d7b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:53.553030 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3274a169-0d16-4792-bcfd-1a59ea064d7b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:53.553471 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3274a169-0d16-4792-bcfd-1a59ea064d7b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:53.554165 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3274a169-0d16-4792-bcfd-1a59ea064d7b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:53.554616 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3274a169-0d16-4792-bcfd-1a59ea064d7b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:53.555035 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3274a169-0d16-4792-bcfd-1a59ea064d7b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:53.931469 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-3274a169-0d16-4792-bcfd-1a59ea064d7b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:53.939816 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-3274a169-0d16-4792-bcfd-1a59ea064d7b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:53.941274 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-3274a169-0d16-4792-bcfd-1a59ea064d7b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:53.942407 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-3274a169-0d16-4792-bcfd-1a59ea064d7b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1405 microversion: 2.20 time: 0.401558 Aug 31 01:26:53.942976 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 265/528] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:26:53 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1405 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:26:54.071479 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-4120303d-8501-4708-b51c-58d0320641e2 req-382adeb6-7e6f-493a-b5ea-aab34c290be4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7311a59-7d10-4edb-be41-f6872e563e09", "tag": "1302084d-99f4-4cd1-8b6d-4a829a883993"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:26:54.082207 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-4120303d-8501-4708-b51c-58d0320641e2 req-382adeb6-7e6f-493a-b5ea-aab34c290be4 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:54.082678 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-4120303d-8501-4708-b51c-58d0320641e2 req-382adeb6-7e6f-493a-b5ea-aab34c290be4 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:54.083104 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-4120303d-8501-4708-b51c-58d0320641e2 req-382adeb6-7e6f-493a-b5ea-aab34c290be4 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:54.094536 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-4120303d-8501-4708-b51c-58d0320641e2 req-382adeb6-7e6f-493a-b5ea-aab34c290be4 service nova] Creating event network-changed:1302084d-99f4-4cd1-8b6d-4a829a883993 for instance b7311a59-7d10-4edb-be41-f6872e563e09 on hv-cinder-85528 Aug 31 01:26:54.099298 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-4120303d-8501-4708-b51c-58d0320641e2 req-382adeb6-7e6f-493a-b5ea-aab34c290be4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031468 Aug 31 01:26:54.100141 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 264/529] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:26:54.968115 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-12c00f45-4038-44c6-b6bd-d3140224ec79 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:54.968649 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-12c00f45-4038-44c6-b6bd-d3140224ec79 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:54.975086 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-12c00f45-4038-44c6-b6bd-d3140224ec79 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:54.975562 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-12c00f45-4038-44c6-b6bd-d3140224ec79 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:54.975992 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-12c00f45-4038-44c6-b6bd-d3140224ec79 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:54.976672 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-12c00f45-4038-44c6-b6bd-d3140224ec79 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:54.977146 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-12c00f45-4038-44c6-b6bd-d3140224ec79 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:54.977563 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-12c00f45-4038-44c6-b6bd-d3140224ec79 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:55.105595 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-12c00f45-4038-44c6-b6bd-d3140224ec79 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:55.113511 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-12c00f45-4038-44c6-b6bd-d3140224ec79 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:55.114935 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-12c00f45-4038-44c6-b6bd-d3140224ec79 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:55.116019 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-12c00f45-4038-44c6-b6bd-d3140224ec79 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1405 microversion: 2.20 time: 0.152530 Aug 31 01:26:55.116581 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 266/530] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:26:54 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:26:56.140000 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-1a3f11fc-8f9c-4ea6-8a56-d05af86dd809 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:56.140693 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-1a3f11fc-8f9c-4ea6-8a56-d05af86dd809 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:56.146800 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1a3f11fc-8f9c-4ea6-8a56-d05af86dd809 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:56.147283 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1a3f11fc-8f9c-4ea6-8a56-d05af86dd809 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:56.147765 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1a3f11fc-8f9c-4ea6-8a56-d05af86dd809 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:56.148397 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1a3f11fc-8f9c-4ea6-8a56-d05af86dd809 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:56.148877 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1a3f11fc-8f9c-4ea6-8a56-d05af86dd809 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:56.149298 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1a3f11fc-8f9c-4ea6-8a56-d05af86dd809 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:56.276933 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-1a3f11fc-8f9c-4ea6-8a56-d05af86dd809 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:56.284897 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-1a3f11fc-8f9c-4ea6-8a56-d05af86dd809 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:56.286323 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-1a3f11fc-8f9c-4ea6-8a56-d05af86dd809 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:56.287420 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-1a3f11fc-8f9c-4ea6-8a56-d05af86dd809 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1405 microversion: 2.20 time: 0.152156 Aug 31 01:26:56.288007 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 265/531] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:26:56 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:26:57.310186 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-0f04d986-c229-41d9-a584-46d7d68e88ad tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:57.311306 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-0f04d986-c229-41d9-a584-46d7d68e88ad tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:57.317703 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0f04d986-c229-41d9-a584-46d7d68e88ad tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:57.318180 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0f04d986-c229-41d9-a584-46d7d68e88ad tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:57.318612 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0f04d986-c229-41d9-a584-46d7d68e88ad tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:57.319294 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0f04d986-c229-41d9-a584-46d7d68e88ad tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:57.319739 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0f04d986-c229-41d9-a584-46d7d68e88ad tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:57.320157 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0f04d986-c229-41d9-a584-46d7d68e88ad tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:57.446165 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-0f04d986-c229-41d9-a584-46d7d68e88ad tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:57.454430 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-0f04d986-c229-41d9-a584-46d7d68e88ad tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:57.455852 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-0f04d986-c229-41d9-a584-46d7d68e88ad tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:57.456968 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-0f04d986-c229-41d9-a584-46d7d68e88ad tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1405 microversion: 2.20 time: 0.150688 Aug 31 01:26:57.457527 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 267/532] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:26:57 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:26:58.479611 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-4258a2ba-e2a0-40e0-b55f-ddfa8c61c612 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:58.480129 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-4258a2ba-e2a0-40e0-b55f-ddfa8c61c612 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:58.486573 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4258a2ba-e2a0-40e0-b55f-ddfa8c61c612 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:58.487042 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4258a2ba-e2a0-40e0-b55f-ddfa8c61c612 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:58.487464 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4258a2ba-e2a0-40e0-b55f-ddfa8c61c612 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:58.488139 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4258a2ba-e2a0-40e0-b55f-ddfa8c61c612 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:58.488587 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4258a2ba-e2a0-40e0-b55f-ddfa8c61c612 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:58.489029 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4258a2ba-e2a0-40e0-b55f-ddfa8c61c612 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:58.619005 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-4258a2ba-e2a0-40e0-b55f-ddfa8c61c612 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:58.622678 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:26:58.627761 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-4258a2ba-e2a0-40e0-b55f-ddfa8c61c612 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:58.634237 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-4258a2ba-e2a0-40e0-b55f-ddfa8c61c612 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:58.634237 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-4258a2ba-e2a0-40e0-b55f-ddfa8c61c612 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1405 microversion: 2.20 time: 0.154817 Aug 31 01:26:58.634237 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 266/533] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:26:58 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:26:59.653239 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-293503ed-46fa-4cd1-8368-1e52df13927d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:59.653842 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-293503ed-46fa-4cd1-8368-1e52df13927d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:59.660237 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-293503ed-46fa-4cd1-8368-1e52df13927d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:59.660714 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-293503ed-46fa-4cd1-8368-1e52df13927d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:59.661204 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-293503ed-46fa-4cd1-8368-1e52df13927d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:59.661890 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-293503ed-46fa-4cd1-8368-1e52df13927d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:59.662340 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-293503ed-46fa-4cd1-8368-1e52df13927d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:59.662760 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-293503ed-46fa-4cd1-8368-1e52df13927d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:59.787765 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-293503ed-46fa-4cd1-8368-1e52df13927d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:59.796179 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-293503ed-46fa-4cd1-8368-1e52df13927d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:59.797629 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-293503ed-46fa-4cd1-8368-1e52df13927d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:26:59.798714 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-293503ed-46fa-4cd1-8368-1e52df13927d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1405 microversion: 2.20 time: 0.149364 Aug 31 01:26:59.799270 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 268/534] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:26:59 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1405 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:26:59.936244 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-a29ddae1-bca8-49d9-8d6c-6095f774cf6f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:26:59.937476 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-a29ddae1-bca8-49d9-8d6c-6095f774cf6f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:26:59.944614 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a29ddae1-bca8-49d9-8d6c-6095f774cf6f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:59.948198 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a29ddae1-bca8-49d9-8d6c-6095f774cf6f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:59.948198 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a29ddae1-bca8-49d9-8d6c-6095f774cf6f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:26:59.948198 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a29ddae1-bca8-49d9-8d6c-6095f774cf6f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:26:59.948198 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a29ddae1-bca8-49d9-8d6c-6095f774cf6f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:26:59.948568 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a29ddae1-bca8-49d9-8d6c-6095f774cf6f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:00.030386 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.objects.instance [None req-a29ddae1-bca8-49d9-8d6c-6095f774cf6f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lazy-loading 'services' on Instance uuid 380077d1-0ed7-47ac-9e19-5425164e6da1 {{(pid=121025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:27:00.151127 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-bcfb78ec-d579-48e2-b9f8-59ecd856e104 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:00.151645 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-bcfb78ec-d579-48e2-b9f8-59ecd856e104 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: acd1b630-d842-47ea-8019-f405c41ad7d3] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:00.153673 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell0:SELECT=2 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:27:00.154419 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell0:SELECT=6 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:27:00.159476 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-bcfb78ec-d579-48e2-b9f8-59ecd856e104 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:00.159965 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-bcfb78ec-d579-48e2-b9f8-59ecd856e104 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:00.160403 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-bcfb78ec-d579-48e2-b9f8-59ecd856e104 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:00.161135 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-bcfb78ec-d579-48e2-b9f8-59ecd856e104 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:00.161763 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-bcfb78ec-d579-48e2-b9f8-59ecd856e104 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:00.162303 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-bcfb78ec-d579-48e2-b9f8-59ecd856e104 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:00.186222 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-bcfb78ec-d579-48e2-b9f8-59ecd856e104 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3/ips" status: 200 len: 148 microversion: 2.1 time: 0.039056 Aug 31 01:27:00.186800 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 269/535] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Aug 31 01:27:00 2022] GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3/ips => generated 148 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:27:00.196708 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [req-87d242fa-a3c9-47ef-a77a-6df3e4e5da14 req-56624b34-c657-46b2-bfce-6c80029e3473 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7311a59-7d10-4edb-be41-f6872e563e09", "name": "network-vif-plugged", "status": "completed", "tag": "1302084d-99f4-4cd1-8b6d-4a829a883993"}]} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:27:00.207534 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-87d242fa-a3c9-47ef-a77a-6df3e4e5da14 req-56624b34-c657-46b2-bfce-6c80029e3473 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:00.208021 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-87d242fa-a3c9-47ef-a77a-6df3e4e5da14 req-56624b34-c657-46b2-bfce-6c80029e3473 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:00.208451 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-87d242fa-a3c9-47ef-a77a-6df3e4e5da14 req-56624b34-c657-46b2-bfce-6c80029e3473 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:00.219802 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.compute.server_external_events [req-87d242fa-a3c9-47ef-a77a-6df3e4e5da14 req-56624b34-c657-46b2-bfce-6c80029e3473 service nova] Creating event network-vif-plugged:1302084d-99f4-4cd1-8b6d-4a829a883993 for instance b7311a59-7d10-4edb-be41-f6872e563e09 on hv-cinder-85528 Aug 31 01:27:00.224857 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [req-87d242fa-a3c9-47ef-a77a-6df3e4e5da14 req-56624b34-c657-46b2-bfce-6c80029e3473 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032388 Aug 31 01:27:00.225440 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 270/536] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:27:00.271217 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-a29ddae1-bca8-49d9-8d6c-6095f774cf6f tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "DELETE /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1/os-volume_attachments/9118fa83-f3fd-4d9c-9325-562ffc2f04d3" status: 202 len: 0 microversion: 2.1 time: 0.338876 Aug 31 01:27:00.272631 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 267/537] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 31 01:26:59 2022] DELETE /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1/os-volume_attachments/9118fa83-f3fd-4d9c-9325-562ffc2f04d3 => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 01:27:00.282065 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-107aa0b5-cf66-46a2-80e8-c66a5e7021b8 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:00.284284 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-107aa0b5-cf66-46a2-80e8-c66a5e7021b8 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:00.292465 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-107aa0b5-cf66-46a2-80e8-c66a5e7021b8 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:00.293224 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-107aa0b5-cf66-46a2-80e8-c66a5e7021b8 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:00.293970 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-107aa0b5-cf66-46a2-80e8-c66a5e7021b8 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:00.294750 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-107aa0b5-cf66-46a2-80e8-c66a5e7021b8 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:00.295205 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-107aa0b5-cf66-46a2-80e8-c66a5e7021b8 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:00.295626 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-107aa0b5-cf66-46a2-80e8-c66a5e7021b8 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:00.327785 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-107aa0b5-cf66-46a2-80e8-c66a5e7021b8 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050376 Aug 31 01:27:00.328311 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 271/538] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 01:27:00 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:27:00.818625 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell0:SELECT=6 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:27:00.822893 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-e41e2c63-802a-4c64-89b9-67f1ed21f88a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:00.823601 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-e41e2c63-802a-4c64-89b9-67f1ed21f88a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:00.830561 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e41e2c63-802a-4c64-89b9-67f1ed21f88a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:00.831047 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e41e2c63-802a-4c64-89b9-67f1ed21f88a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:00.837209 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e41e2c63-802a-4c64-89b9-67f1ed21f88a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:00.837209 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e41e2c63-802a-4c64-89b9-67f1ed21f88a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:00.837209 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e41e2c63-802a-4c64-89b9-67f1ed21f88a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:00.837209 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e41e2c63-802a-4c64-89b9-67f1ed21f88a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:00.973787 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-e41e2c63-802a-4c64-89b9-67f1ed21f88a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:00.981886 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-e41e2c63-802a-4c64-89b9-67f1ed21f88a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:00.983327 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-e41e2c63-802a-4c64-89b9-67f1ed21f88a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:00.984402 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-e41e2c63-802a-4c64-89b9-67f1ed21f88a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1405 microversion: 2.20 time: 0.166767 Aug 31 01:27:00.985027 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 268/539] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:27:00 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:27:01.339572 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-c95bf129-ce12-400a-9b13-ba89ac61decd tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:01.341780 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-c95bf129-ce12-400a-9b13-ba89ac61decd tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:01.348092 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c95bf129-ce12-400a-9b13-ba89ac61decd tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:01.348572 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c95bf129-ce12-400a-9b13-ba89ac61decd tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:01.349058 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c95bf129-ce12-400a-9b13-ba89ac61decd tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:01.349815 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c95bf129-ce12-400a-9b13-ba89ac61decd tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:01.350268 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c95bf129-ce12-400a-9b13-ba89ac61decd tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:01.352857 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c95bf129-ce12-400a-9b13-ba89ac61decd tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:01.381221 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-c95bf129-ce12-400a-9b13-ba89ac61decd tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045586 Aug 31 01:27:01.381822 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 272/540] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 01:27:01 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:27:01.868116 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-ed0b3e24-1419-4f3d-92a5-bcb6532ae264 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dda92c1e-6e49-49dd-9160-5ff578a3ab3a"}} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:27:01.871070 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-ed0b3e24-1419-4f3d-92a5-bcb6532ae264 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: acd1b630-d842-47ea-8019-f405c41ad7d3] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:01.877042 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ed0b3e24-1419-4f3d-92a5-bcb6532ae264 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:01.877533 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ed0b3e24-1419-4f3d-92a5-bcb6532ae264 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:01.877975 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ed0b3e24-1419-4f3d-92a5-bcb6532ae264 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:01.878672 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ed0b3e24-1419-4f3d-92a5-bcb6532ae264 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:01.879124 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ed0b3e24-1419-4f3d-92a5-bcb6532ae264 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:01.879548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ed0b3e24-1419-4f3d-92a5-bcb6532ae264 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:02.008612 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-aceb10ac-a9a4-4025-9336-9a6d29372fc5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:02.009280 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-aceb10ac-a9a4-4025-9336-9a6d29372fc5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:02.015324 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-aceb10ac-a9a4-4025-9336-9a6d29372fc5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:02.015807 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-aceb10ac-a9a4-4025-9336-9a6d29372fc5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:02.016240 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-aceb10ac-a9a4-4025-9336-9a6d29372fc5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:02.017010 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-aceb10ac-a9a4-4025-9336-9a6d29372fc5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:02.017469 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-aceb10ac-a9a4-4025-9336-9a6d29372fc5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:02.017891 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-aceb10ac-a9a4-4025-9336-9a6d29372fc5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:02.146419 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-aceb10ac-a9a4-4025-9336-9a6d29372fc5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:02.154589 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-aceb10ac-a9a4-4025-9336-9a6d29372fc5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:02.156682 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-aceb10ac-a9a4-4025-9336-9a6d29372fc5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:02.157811 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-aceb10ac-a9a4-4025-9336-9a6d29372fc5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1405 microversion: 2.20 time: 0.153982 Aug 31 01:27:02.158369 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 273/541] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:27:02 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 01:27:02.393448 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-ce091e56-c33b-4d35-93ee-5053645731bc tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:02.395563 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-ce091e56-c33b-4d35-93ee-5053645731bc tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:02.401925 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ce091e56-c33b-4d35-93ee-5053645731bc tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:02.402405 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ce091e56-c33b-4d35-93ee-5053645731bc tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:02.402839 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ce091e56-c33b-4d35-93ee-5053645731bc tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:02.403523 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ce091e56-c33b-4d35-93ee-5053645731bc tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:02.403977 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ce091e56-c33b-4d35-93ee-5053645731bc tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:02.404397 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ce091e56-c33b-4d35-93ee-5053645731bc tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:02.433798 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-ce091e56-c33b-4d35-93ee-5053645731bc tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044304 Aug 31 01:27:02.434346 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 274/542] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 01:27:02 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 01:27:02.512166 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-b84b2654-ea84-4ede-8afe-5201501ec052 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:02.512652 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-b84b2654-ea84-4ede-8afe-5201501ec052 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:02.518525 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b84b2654-ea84-4ede-8afe-5201501ec052 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:02.518997 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b84b2654-ea84-4ede-8afe-5201501ec052 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:02.519422 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b84b2654-ea84-4ede-8afe-5201501ec052 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:02.520098 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b84b2654-ea84-4ede-8afe-5201501ec052 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:02.520547 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b84b2654-ea84-4ede-8afe-5201501ec052 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:02.520981 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b84b2654-ea84-4ede-8afe-5201501ec052 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:02.548038 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-b84b2654-ea84-4ede-8afe-5201501ec052 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Going to try to terminate instance {{(pid=121026) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 01:27:02.832401 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-b84b2654-ea84-4ede-8afe-5201501ec052 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "DELETE /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 204 len: 0 microversion: 2.1 time: 0.323735 Aug 31 01:27:02.833047 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 275/543] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 01:27:02 2022] DELETE /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 01:27:02.841098 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-3c505887-cfd1-490d-b60f-ed1fdf1f5fb1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:02.841791 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-3c505887-cfd1-490d-b60f-ed1fdf1f5fb1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:02.848327 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3c505887-cfd1-490d-b60f-ed1fdf1f5fb1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:02.848844 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3c505887-cfd1-490d-b60f-ed1fdf1f5fb1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:02.849280 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3c505887-cfd1-490d-b60f-ed1fdf1f5fb1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:02.849977 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3c505887-cfd1-490d-b60f-ed1fdf1f5fb1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:02.850429 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3c505887-cfd1-490d-b60f-ed1fdf1f5fb1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:02.850856 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3c505887-cfd1-490d-b60f-ed1fdf1f5fb1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:02.980596 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-3c505887-cfd1-490d-b60f-ed1fdf1f5fb1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:02.988355 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-3c505887-cfd1-490d-b60f-ed1fdf1f5fb1 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1691 microversion: 2.1 time: 0.151227 Aug 31 01:27:02.988958 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 276/544] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:02 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1691 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:27:03.180090 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-ad106df2-9663-4c96-976d-6223fcaa9fff tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:03.180697 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-ad106df2-9663-4c96-976d-6223fcaa9fff tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:03.186709 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ad106df2-9663-4c96-976d-6223fcaa9fff tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:03.187202 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ad106df2-9663-4c96-976d-6223fcaa9fff tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:03.188172 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ad106df2-9663-4c96-976d-6223fcaa9fff tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:03.188886 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ad106df2-9663-4c96-976d-6223fcaa9fff tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:03.189538 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ad106df2-9663-4c96-976d-6223fcaa9fff tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:03.189956 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ad106df2-9663-4c96-976d-6223fcaa9fff tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:03.208284 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:27:03.321743 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-ed0b3e24-1419-4f3d-92a5-bcb6532ae264 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "POST /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.457388 Aug 31 01:27:03.322465 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 269/545] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 31 01:27:01 2022] POST /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3/os-volume_attachments => generated 194 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:27:03.325910 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-ad106df2-9663-4c96-976d-6223fcaa9fff tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:03.335256 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-ad106df2-9663-4c96-976d-6223fcaa9fff tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:03.336804 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-ad106df2-9663-4c96-976d-6223fcaa9fff tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:03.338196 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-ad106df2-9663-4c96-976d-6223fcaa9fff tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1597 microversion: 2.20 time: 0.162047 Aug 31 01:27:03.339983 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 277/546] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:27:03 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1597 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 01:27:03.360890 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-6d6d07d3-b67c-44c0-99eb-96b631b05711 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:03.361483 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-6d6d07d3-b67c-44c0-99eb-96b631b05711 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:03.367802 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6d6d07d3-b67c-44c0-99eb-96b631b05711 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:03.368298 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6d6d07d3-b67c-44c0-99eb-96b631b05711 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:03.368749 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6d6d07d3-b67c-44c0-99eb-96b631b05711 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:03.369454 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6d6d07d3-b67c-44c0-99eb-96b631b05711 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:03.369910 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6d6d07d3-b67c-44c0-99eb-96b631b05711 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:03.370334 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6d6d07d3-b67c-44c0-99eb-96b631b05711 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:03.450156 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-6d6d07d3-b67c-44c0-99eb-96b631b05711 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093708 Aug 31 01:27:03.450951 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 270/547] 10.222.0.20 () {60 vars in 1316 bytes} [Wed Aug 31 01:27:03 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 01:27:04.009555 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-4412f593-dc7e-4304-b1c9-2753a7c62e27 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:04.010213 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-4412f593-dc7e-4304-b1c9-2753a7c62e27 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:04.018408 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4412f593-dc7e-4304-b1c9-2753a7c62e27 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:04.018896 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4412f593-dc7e-4304-b1c9-2753a7c62e27 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:04.019326 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4412f593-dc7e-4304-b1c9-2753a7c62e27 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:04.020028 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4412f593-dc7e-4304-b1c9-2753a7c62e27 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:04.020476 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4412f593-dc7e-4304-b1c9-2753a7c62e27 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:04.020949 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4412f593-dc7e-4304-b1c9-2753a7c62e27 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:04.155755 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-4412f593-dc7e-4304-b1c9-2753a7c62e27 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:04.164221 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-4412f593-dc7e-4304-b1c9-2753a7c62e27 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1691 microversion: 2.1 time: 0.158549 Aug 31 01:27:04.166916 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 278/548] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:04 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:27:04.651483 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-794d9686-4107-422e-b23f-bde667431a80 req-36419cc2-3106-42cf-ba77-440a5fa5b961 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7311a59-7d10-4edb-be41-f6872e563e09", "tag": "1302084d-99f4-4cd1-8b6d-4a829a883993"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:27:04.661253 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-794d9686-4107-422e-b23f-bde667431a80 req-36419cc2-3106-42cf-ba77-440a5fa5b961 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:04.661735 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-794d9686-4107-422e-b23f-bde667431a80 req-36419cc2-3106-42cf-ba77-440a5fa5b961 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:04.662165 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-794d9686-4107-422e-b23f-bde667431a80 req-36419cc2-3106-42cf-ba77-440a5fa5b961 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:04.672757 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-794d9686-4107-422e-b23f-bde667431a80 req-36419cc2-3106-42cf-ba77-440a5fa5b961 service nova] Creating event network-changed:1302084d-99f4-4cd1-8b6d-4a829a883993 for instance b7311a59-7d10-4edb-be41-f6872e563e09 on hv-cinder-85528 Aug 31 01:27:04.677557 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-794d9686-4107-422e-b23f-bde667431a80 req-36419cc2-3106-42cf-ba77-440a5fa5b961 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030208 Aug 31 01:27:04.678145 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 271/549] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:27:05.185352 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-39218aef-bfb9-45ee-ba8e-5f30111bb5e7 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:05.185900 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-39218aef-bfb9-45ee-ba8e-5f30111bb5e7 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:05.192464 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-39218aef-bfb9-45ee-ba8e-5f30111bb5e7 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:05.192990 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-39218aef-bfb9-45ee-ba8e-5f30111bb5e7 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:05.193429 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-39218aef-bfb9-45ee-ba8e-5f30111bb5e7 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:05.194127 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-39218aef-bfb9-45ee-ba8e-5f30111bb5e7 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:05.194579 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-39218aef-bfb9-45ee-ba8e-5f30111bb5e7 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:05.194996 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-39218aef-bfb9-45ee-ba8e-5f30111bb5e7 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:05.329703 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-39218aef-bfb9-45ee-ba8e-5f30111bb5e7 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:05.337511 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-39218aef-bfb9-45ee-ba8e-5f30111bb5e7 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1691 microversion: 2.1 time: 0.156041 Aug 31 01:27:05.338098 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 279/550] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:05 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:27:06.360184 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-0766f2db-fd45-4e33-8602-212fbfc47d76 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:06.360915 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-0766f2db-fd45-4e33-8602-212fbfc47d76 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:06.367126 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0766f2db-fd45-4e33-8602-212fbfc47d76 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:06.367603 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0766f2db-fd45-4e33-8602-212fbfc47d76 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:06.368037 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0766f2db-fd45-4e33-8602-212fbfc47d76 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:06.368752 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0766f2db-fd45-4e33-8602-212fbfc47d76 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:06.369197 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0766f2db-fd45-4e33-8602-212fbfc47d76 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:06.369621 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0766f2db-fd45-4e33-8602-212fbfc47d76 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:06.509428 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-0766f2db-fd45-4e33-8602-212fbfc47d76 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:06.521057 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-0766f2db-fd45-4e33-8602-212fbfc47d76 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1691 microversion: 2.1 time: 0.166137 Aug 31 01:27:06.521670 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 272/551] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:06 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:27:07.499576 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [req-ccf48c4d-b6e2-40d6-a48a-57378a555d6e req-9aced392-9cb9-45ee-a2f7-86c8c8fb3493 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "380077d1-0ed7-47ac-9e19-5425164e6da1", "name": "network-vif-deleted", "tag": "6715d43f-3649-46e9-b421-5ed74efa38b9"}]} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:27:07.508122 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:27:07.510558 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-ccf48c4d-b6e2-40d6-a48a-57378a555d6e req-9aced392-9cb9-45ee-a2f7-86c8c8fb3493 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:07.511044 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-ccf48c4d-b6e2-40d6-a48a-57378a555d6e req-9aced392-9cb9-45ee-a2f7-86c8c8fb3493 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:07.511499 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-ccf48c4d-b6e2-40d6-a48a-57378a555d6e req-9aced392-9cb9-45ee-a2f7-86c8c8fb3493 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:07.523120 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.compute.server_external_events [req-ccf48c4d-b6e2-40d6-a48a-57378a555d6e req-9aced392-9cb9-45ee-a2f7-86c8c8fb3493 service nova] Creating event network-vif-deleted:6715d43f-3649-46e9-b421-5ed74efa38b9 for instance 380077d1-0ed7-47ac-9e19-5425164e6da1 on hv-cinder-85528 Aug 31 01:27:07.528023 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [req-ccf48c4d-b6e2-40d6-a48a-57378a555d6e req-9aced392-9cb9-45ee-a2f7-86c8c8fb3493 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032302 Aug 31 01:27:07.528646 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 280/552] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:27:07.545001 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-9f4129b7-c867-4e84-b16d-133a2ace4734 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:07.545651 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-9f4129b7-c867-4e84-b16d-133a2ace4734 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:07.552871 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9f4129b7-c867-4e84-b16d-133a2ace4734 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:07.553419 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9f4129b7-c867-4e84-b16d-133a2ace4734 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:07.553834 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9f4129b7-c867-4e84-b16d-133a2ace4734 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:07.554535 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9f4129b7-c867-4e84-b16d-133a2ace4734 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:07.554991 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9f4129b7-c867-4e84-b16d-133a2ace4734 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:07.555410 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9f4129b7-c867-4e84-b16d-133a2ace4734 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:07.632229 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-9f4129b7-c867-4e84-b16d-133a2ace4734 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:07.643378 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-9f4129b7-c867-4e84-b16d-133a2ace4734 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1624 microversion: 2.1 time: 0.102301 Aug 31 01:27:07.644788 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 273/553] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:07 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1624 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:27:08.666065 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-8812026e-94c6-4b9c-90cf-8bec5824b0ae tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:08.666807 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-8812026e-94c6-4b9c-90cf-8bec5824b0ae tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:08.673362 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8812026e-94c6-4b9c-90cf-8bec5824b0ae tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:08.673846 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8812026e-94c6-4b9c-90cf-8bec5824b0ae tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:08.674283 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8812026e-94c6-4b9c-90cf-8bec5824b0ae tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:08.674970 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8812026e-94c6-4b9c-90cf-8bec5824b0ae tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:08.675422 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8812026e-94c6-4b9c-90cf-8bec5824b0ae tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:08.675838 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8812026e-94c6-4b9c-90cf-8bec5824b0ae tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:08.707517 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8812026e-94c6-4b9c-90cf-8bec5824b0ae tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:08.707994 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8812026e-94c6-4b9c-90cf-8bec5824b0ae tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:08.708425 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8812026e-94c6-4b9c-90cf-8bec5824b0ae tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:08.708899 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.objects.instance [None req-8812026e-94c6-4b9c-90cf-8bec5824b0ae tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lazy-loading 'fault' on Instance uuid 380077d1-0ed7-47ac-9e19-5425164e6da1 {{(pid=121026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:27:08.753822 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-8812026e-94c6-4b9c-90cf-8bec5824b0ae tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:08.761672 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-8812026e-94c6-4b9c-90cf-8bec5824b0ae tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 200 len: 1336 microversion: 2.1 time: 0.100992 Aug 31 01:27:08.769112 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 281/554] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:08 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 1336 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:27:09.783888 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-6f878c02-702b-4d70-ba9b-ed3122ebab04 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:09.784502 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-6f878c02-702b-4d70-ba9b-ed3122ebab04 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: 380077d1-0ed7-47ac-9e19-5425164e6da1] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:09.786976 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:27:09.791611 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6f878c02-702b-4d70-ba9b-ed3122ebab04 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:09.792094 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6f878c02-702b-4d70-ba9b-ed3122ebab04 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:09.792552 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6f878c02-702b-4d70-ba9b-ed3122ebab04 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:09.793285 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6f878c02-702b-4d70-ba9b-ed3122ebab04 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:09.793732 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6f878c02-702b-4d70-ba9b-ed3122ebab04 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:09.794148 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6f878c02-702b-4d70-ba9b-ed3122ebab04 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:09.809215 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.wsgi [None req-6f878c02-702b-4d70-ba9b-ed3122ebab04 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] HTTP exception thrown: Instance 380077d1-0ed7-47ac-9e19-5425164e6da1 could not be found. Aug 31 01:27:09.810808 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-6f878c02-702b-4d70-ba9b-ed3122ebab04 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Request method failure captured: Aug 31 01:27:09.810808 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: request: GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 HTTP/1.1 Aug 31 01:27:09.810808 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept: application/json Aug 31 01:27:09.810808 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept-Encoding: identity Aug 31 01:27:09.810808 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Connection: close Aug 31 01:27:09.810808 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Length: 0 Aug 31 01:27:09.810808 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Type: application/json Aug 31 01:27:09.810808 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Host: 10.222.0.20 Aug 31 01:27:09.810808 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Openstack-System-Scope: None Aug 31 01:27:09.810808 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: User-Agent: python-urllib3/1.26.12 Aug 31 01:27:09.810808 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Auth-Token: gAAAAABjDrfcuhRqsMrMNTjo6mUtTq8SbDe9MkKQW1DPTn6rIQGU7H4zaD_aUkmczj_TdvdQczHlpInuXFz_PGsDLzVXnk0dWRrYAJmuB4iGkRs9-IEfWHKdmN10--_NmP9zX5MAawHt61YTHfjDuXxTKPEPlk6b4MU77kQiT6Ux_ynynzBaDZY Aug 31 01:27:09.810808 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Id: None Aug 31 01:27:09.810808 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Name: None Aug 31 01:27:09.810808 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Identity-Status: Confirmed Aug 31 01:27:09.810808 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Is-Admin-Project: True Aug 31 01:27:09.810808 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Id: default Aug 31 01:27:09.810808 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Name: Default Aug 31 01:27:09.810808 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Id: d58414b1dd2342d58cc7665aee50b86b Aug 31 01:27:09.810808 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2102440878 Aug 31 01:27:09.810808 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Role: member,reader Aug 31 01:27:09.810808 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Roles: member,reader Aug 31 01:27:09.812387 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d58414b1dd2342d58cc7665aee50b86b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d58414b1dd2342d58cc7665aee50b86b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d58414b1dd2342d58cc7665aee50b86b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d58414b1dd2342d58cc7665aee50b86b"}]}] Aug 31 01:27:09.812387 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2102440878 Aug 31 01:27:09.812387 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Id: d58414b1dd2342d58cc7665aee50b86b Aug 31 01:27:09.812387 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2102440878 Aug 31 01:27:09.812387 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User: tempest-ServerRescueNegativeTestJSON-2102440878-project Aug 31 01:27:09.812387 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Id: default Aug 31 01:27:09.812387 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Name: Default Aug 31 01:27:09.812387 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Id: 71d0408df86f4be0ac59cc80575a14e2 Aug 31 01:27:09.812387 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2102440878-project Aug 31 01:27:09.812387 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: method: > Aug 31 01:27:09.812387 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: exception: Instance 380077d1-0ed7-47ac-9e19-5425164e6da1 could not be found. Aug 31 01:27:09.812387 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: action_args: {'id': '380077d1-0ed7-47ac-9e19-5425164e6da1'} Aug 31 01:27:09.813296 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:27:09.813296 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:27:09.813296 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:27:09.813296 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:27:09.813296 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:27:09.813296 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:27:09.813296 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:27:09.813296 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:27:09.813296 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:27:09.813296 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:27:09.813296 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 380077d1-0ed7-47ac-9e19-5425164e6da1 could not be found. Aug 31 01:27:09.813296 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:27:09.813296 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:27:09.813296 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:27:09.813296 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:27:09.813296 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:27:09.813296 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:27:09.813296 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:27:09.813296 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:27:09.813296 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:27:09.814795 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:27:09.814795 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:27:09.814795 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:27:09.814795 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:27:09.814795 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:27:09.814795 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:27:09.814795 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:27:09.814795 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 380077d1-0ed7-47ac-9e19-5425164e6da1 could not be found. Aug 31 01:27:09.814795 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:27:09.814795 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:27:09.814795 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:27:09.814795 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:27:09.814795 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:27:09.814795 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:27:09.814795 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:27:09.814795 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:27:09.814795 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 380077d1-0ed7-47ac-9e19-5425164e6da1 could not be found. Aug 31 01:27:09.814795 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:27:09.816167 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-6f878c02-702b-4d70-ba9b-ed3122ebab04 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Returning 404 to user: Instance 380077d1-0ed7-47ac-9e19-5425164e6da1 could not be found. {{(pid=121025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:27:09.816167 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-6f878c02-702b-4d70-ba9b-ed3122ebab04 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1" status: 404 len: 111 microversion: 2.1 time: 0.032760 Aug 31 01:27:09.816167 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 274/555] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:09 2022] GET /compute/v2.1/servers/380077d1-0ed7-47ac-9e19-5425164e6da1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:27:09.821206 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-7ee577e7-7bf8-4981-970e-534dd484d39a tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '.version_select at 0x7f1fe17b9ee0>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:09.901357 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-7ee577e7-7bf8-4981-970e-534dd484d39a tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1888667198" status: 202 len: 0 microversion: 2.1 time: 0.084186 Aug 31 01:27:09.901982 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 282/556] 10.222.0.20 () {58 vars in 1221 bytes} [Wed Aug 31 01:27:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1888667198 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 01:27:13.220221 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-5c0018bb-ed32-4e69-8875-aca591fb5965 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:13.220714 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-5c0018bb-ed32-4e69-8875-aca591fb5965 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:13.227497 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5c0018bb-ed32-4e69-8875-aca591fb5965 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:13.227985 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5c0018bb-ed32-4e69-8875-aca591fb5965 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:13.228575 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5c0018bb-ed32-4e69-8875-aca591fb5965 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:13.229170 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5c0018bb-ed32-4e69-8875-aca591fb5965 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:13.229560 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5c0018bb-ed32-4e69-8875-aca591fb5965 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:13.229985 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5c0018bb-ed32-4e69-8875-aca591fb5965 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:13.255906 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-5c0018bb-ed32-4e69-8875-aca591fb5965 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Going to try to terminate instance {{(pid=121025) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 01:27:13.580693 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-5c0018bb-ed32-4e69-8875-aca591fb5965 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 204 len: 0 microversion: 2.1 time: 0.364366 Aug 31 01:27:13.581276 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 275/557] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 01:27:13 2022] DELETE /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 01:27:13.589310 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-31fbd50a-b83b-4e02-bd2d-724eea8e2720 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:13.589911 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-31fbd50a-b83b-4e02-bd2d-724eea8e2720 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:13.596022 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-31fbd50a-b83b-4e02-bd2d-724eea8e2720 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:13.596491 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-31fbd50a-b83b-4e02-bd2d-724eea8e2720 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:13.596958 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-31fbd50a-b83b-4e02-bd2d-724eea8e2720 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:13.597640 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-31fbd50a-b83b-4e02-bd2d-724eea8e2720 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:13.598579 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-31fbd50a-b83b-4e02-bd2d-724eea8e2720 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:13.598998 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-31fbd50a-b83b-4e02-bd2d-724eea8e2720 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:13.734243 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-31fbd50a-b83b-4e02-bd2d-724eea8e2720 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:13.742425 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-31fbd50a-b83b-4e02-bd2d-724eea8e2720 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 200 len: 1508 microversion: 2.1 time: 0.157066 Aug 31 01:27:13.742979 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 283/558] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:13 2022] GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:27:14.043896 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-14065910-96a9-4993-9f26-42b4becebb7a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dda92c1e-6e49-49dd-9160-5ff578a3ab3a"}} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:27:14.046397 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-14065910-96a9-4993-9f26-42b4becebb7a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: acd1b630-d842-47ea-8019-f405c41ad7d3] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:14.052244 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-14065910-96a9-4993-9f26-42b4becebb7a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:14.052736 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-14065910-96a9-4993-9f26-42b4becebb7a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:14.053183 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-14065910-96a9-4993-9f26-42b4becebb7a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:14.053864 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-14065910-96a9-4993-9f26-42b4becebb7a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:14.054313 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-14065910-96a9-4993-9f26-42b4becebb7a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:14.054732 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-14065910-96a9-4993-9f26-42b4becebb7a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:14.132070 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.wsgi [None req-14065910-96a9-4993-9f26-42b4becebb7a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] HTTP exception thrown: Invalid volume: volume dda92c1e-6e49-49dd-9160-5ff578a3ab3a is already attached to instances: acd1b630-d842-47ea-8019-f405c41ad7d3 Aug 31 01:27:14.133890 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-14065910-96a9-4993-9f26-42b4becebb7a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Request method failure captured: Aug 31 01:27:14.133890 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: request: POST /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3/os-volume_attachments HTTP/1.1 Aug 31 01:27:14.133890 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept: application/json Aug 31 01:27:14.133890 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept-Encoding: identity Aug 31 01:27:14.133890 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Connection: close Aug 31 01:27:14.133890 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Length: 74 Aug 31 01:27:14.133890 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Type: application/json Aug 31 01:27:14.133890 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Host: 10.222.0.20 Aug 31 01:27:14.133890 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Openstack-System-Scope: None Aug 31 01:27:14.133890 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: User-Agent: python-urllib3/1.26.12 Aug 31 01:27:14.133890 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Auth-Token: gAAAAABjDrfet2Sy4N8jKKJoN7i8trLl0KW7DYiW5JhaLj0L5xpx8IJJDKjwB1T51gnweVtzcKX7Vmb1NaayoFFPtTaITD4WxtfyhSUUM3_4_aZ5GptnzhJmrFo6ZwSNdxq7_gCewRQsJwS99WXQ3X8vSLGTrSznkbNFB8yNJvuQw_w6CXmffXc Aug 31 01:27:14.133890 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Id: None Aug 31 01:27:14.133890 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Name: None Aug 31 01:27:14.133890 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Identity-Status: Confirmed Aug 31 01:27:14.133890 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Is-Admin-Project: True Aug 31 01:27:14.133890 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Id: default Aug 31 01:27:14.133890 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Name: Default Aug 31 01:27:14.133890 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Id: 164da7d4776d4e9f8cf6497aa784d312 Aug 31 01:27:14.133890 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Name: tempest-AttachVolumeNegativeTest-1582720348 Aug 31 01:27:14.133890 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Role: member,reader Aug 31 01:27:14.133890 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Roles: member,reader Aug 31 01:27:14.135463 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/164da7d4776d4e9f8cf6497aa784d312"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_164da7d4776d4e9f8cf6497aa784d312", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/164da7d4776d4e9f8cf6497aa784d312"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/164da7d4776d4e9f8cf6497aa784d312"}]}] Aug 31 01:27:14.135463 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant: tempest-AttachVolumeNegativeTest-1582720348 Aug 31 01:27:14.135463 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Id: 164da7d4776d4e9f8cf6497aa784d312 Aug 31 01:27:14.135463 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1582720348 Aug 31 01:27:14.135463 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User: tempest-AttachVolumeNegativeTest-1582720348-project Aug 31 01:27:14.135463 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Id: default Aug 31 01:27:14.135463 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Name: Default Aug 31 01:27:14.135463 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Id: 52ed99737fd240789bb682fd9bf11be3 Aug 31 01:27:14.135463 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Name: tempest-AttachVolumeNegativeTest-1582720348-project Aug 31 01:27:14.135463 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Aug 31 01:27:14.135463 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: {"volumeAttachment": {"volumeId": "dda92c1e-6e49-49dd-9160-5ff578a3ab3a"}} Aug 31 01:27:14.135463 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: method: > Aug 31 01:27:14.138518 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: exception: Invalid volume: volume dda92c1e-6e49-49dd-9160-5ff578a3ab3a is already attached to instances: acd1b630-d842-47ea-8019-f405c41ad7d3 Aug 31 01:27:14.138518 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: action_args: {'server_id': 'acd1b630-d842-47ea-8019-f405c41ad7d3', 'body': {'volumeAttachment': {'volumeId': 'dda92c1e-6e49-49dd-9160-5ff578a3ab3a'}}} Aug 31 01:27:14.138518 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:27:14.138518 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:27:14.138518 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 01:27:14.138518 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 01:27:14.138518 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 01:27:14.138518 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 01:27:14.138518 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 01:27:14.138518 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 01:27:14.138518 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 31 01:27:14.138518 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 31 01:27:14.138518 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 31 01:27:14.138518 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 31 01:27:14.138518 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume dda92c1e-6e49-49dd-9160-5ff578a3ab3a is already attached to instances: acd1b630-d842-47ea-8019-f405c41ad7d3 Aug 31 01:27:14.138518 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:27:14.138518 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:27:14.138518 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:27:14.138518 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:27:14.139904 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:27:14.139904 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:27:14.139904 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:27:14.139904 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:27:14.139904 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:27:14.139904 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:27:14.139904 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 01:27:14.139904 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 01:27:14.139904 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 01:27:14.139904 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 01:27:14.139904 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 01:27:14.139904 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 01:27:14.139904 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 31 01:27:14.139904 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 01:27:14.139904 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume dda92c1e-6e49-49dd-9160-5ff578a3ab3a is already attached to instances: acd1b630-d842-47ea-8019-f405c41ad7d3 Aug 31 01:27:14.139904 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:27:14.139904 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:27:14.139904 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:27:14.139904 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:27:14.139904 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:27:14.141134 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:27:14.141134 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:27:14.141134 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:27:14.141134 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume dda92c1e-6e49-49dd-9160-5ff578a3ab3a is already attached to instances: acd1b630-d842-47ea-8019-f405c41ad7d3 Aug 31 01:27:14.141134 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:27:14.141134 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-14065910-96a9-4993-9f26-42b4becebb7a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Returning 400 to user: Invalid volume: volume dda92c1e-6e49-49dd-9160-5ff578a3ab3a is already attached to instances: acd1b630-d842-47ea-8019-f405c41ad7d3 {{(pid=121025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:27:14.141134 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-14065910-96a9-4993-9f26-42b4becebb7a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "POST /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095739 Aug 31 01:27:14.141134 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 276/559] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 31 01:27:14 2022] POST /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 01:27:14.198773 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-3502ef42-47b4-4521-82ce-564583d0861d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:14.199261 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-3502ef42-47b4-4521-82ce-564583d0861d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: acd1b630-d842-47ea-8019-f405c41ad7d3] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:14.205707 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3502ef42-47b4-4521-82ce-564583d0861d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:14.206180 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3502ef42-47b4-4521-82ce-564583d0861d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:14.206606 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3502ef42-47b4-4521-82ce-564583d0861d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:14.207281 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3502ef42-47b4-4521-82ce-564583d0861d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:14.208235 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3502ef42-47b4-4521-82ce-564583d0861d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:14.208648 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3502ef42-47b4-4521-82ce-564583d0861d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:14.288384 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.objects.instance [None req-3502ef42-47b4-4521-82ce-564583d0861d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lazy-loading 'services' on Instance uuid acd1b630-d842-47ea-8019-f405c41ad7d3 {{(pid=121026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:27:14.522949 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-3502ef42-47b4-4521-82ce-564583d0861d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "DELETE /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3/os-volume_attachments/dda92c1e-6e49-49dd-9160-5ff578a3ab3a" status: 202 len: 0 microversion: 2.1 time: 0.327873 Aug 31 01:27:14.523570 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 284/560] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 31 01:27:14 2022] DELETE /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3/os-volume_attachments/dda92c1e-6e49-49dd-9160-5ff578a3ab3a => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 01:27:14.532379 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-9909200d-3c22-403e-bdd2-f4acfb01c02f tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:14.534709 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-9909200d-3c22-403e-bdd2-f4acfb01c02f tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: acd1b630-d842-47ea-8019-f405c41ad7d3] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:14.541992 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9909200d-3c22-403e-bdd2-f4acfb01c02f tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:14.542519 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9909200d-3c22-403e-bdd2-f4acfb01c02f tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:14.542943 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9909200d-3c22-403e-bdd2-f4acfb01c02f tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:14.543667 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9909200d-3c22-403e-bdd2-f4acfb01c02f tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:14.544110 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9909200d-3c22-403e-bdd2-f4acfb01c02f tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:14.544525 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9909200d-3c22-403e-bdd2-f4acfb01c02f tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:14.573466 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-9909200d-3c22-403e-bdd2-f4acfb01c02f tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045410 Aug 31 01:27:14.574005 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 277/561] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 01:27:14 2022] GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:27:14.763863 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-3669a37b-c39e-40ba-ae06-bffb72875c74 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:14.764543 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-3669a37b-c39e-40ba-ae06-bffb72875c74 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:14.770627 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3669a37b-c39e-40ba-ae06-bffb72875c74 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:14.771104 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3669a37b-c39e-40ba-ae06-bffb72875c74 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:14.771528 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3669a37b-c39e-40ba-ae06-bffb72875c74 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:14.772206 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3669a37b-c39e-40ba-ae06-bffb72875c74 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:14.772649 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3669a37b-c39e-40ba-ae06-bffb72875c74 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:14.773091 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3669a37b-c39e-40ba-ae06-bffb72875c74 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:14.902641 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-3669a37b-c39e-40ba-ae06-bffb72875c74 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:14.910387 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-3669a37b-c39e-40ba-ae06-bffb72875c74 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 200 len: 1508 microversion: 2.1 time: 0.151257 Aug 31 01:27:14.910955 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 285/562] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:14 2022] GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:27:15.586565 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-1ca09974-b714-4eb1-9a87-c4d3b99833a2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:15.588685 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-1ca09974-b714-4eb1-9a87-c4d3b99833a2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: acd1b630-d842-47ea-8019-f405c41ad7d3] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:15.595079 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1ca09974-b714-4eb1-9a87-c4d3b99833a2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:15.595543 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1ca09974-b714-4eb1-9a87-c4d3b99833a2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:15.595967 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1ca09974-b714-4eb1-9a87-c4d3b99833a2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:15.596636 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1ca09974-b714-4eb1-9a87-c4d3b99833a2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:15.597105 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1ca09974-b714-4eb1-9a87-c4d3b99833a2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:15.597518 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1ca09974-b714-4eb1-9a87-c4d3b99833a2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:15.626472 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-1ca09974-b714-4eb1-9a87-c4d3b99833a2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044407 Aug 31 01:27:15.627006 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 278/563] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 01:27:15 2022] GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:27:15.930928 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-b6d7821e-870a-4a66-8993-626914e5a20c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:15.931574 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-b6d7821e-870a-4a66-8993-626914e5a20c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:15.938362 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b6d7821e-870a-4a66-8993-626914e5a20c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:15.938966 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b6d7821e-870a-4a66-8993-626914e5a20c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:15.939407 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b6d7821e-870a-4a66-8993-626914e5a20c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:15.940104 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b6d7821e-870a-4a66-8993-626914e5a20c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:15.940635 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b6d7821e-870a-4a66-8993-626914e5a20c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:15.940992 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b6d7821e-870a-4a66-8993-626914e5a20c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:16.070215 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-b6d7821e-870a-4a66-8993-626914e5a20c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:16.077933 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-b6d7821e-870a-4a66-8993-626914e5a20c tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 200 len: 1508 microversion: 2.1 time: 0.150751 Aug 31 01:27:16.078547 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 286/564] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:15 2022] GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:27:16.638784 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-6c08c1bf-187f-4883-b82c-265f574ea4a7 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:16.641126 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-6c08c1bf-187f-4883-b82c-265f574ea4a7 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: acd1b630-d842-47ea-8019-f405c41ad7d3] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:16.647968 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6c08c1bf-187f-4883-b82c-265f574ea4a7 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:16.648442 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6c08c1bf-187f-4883-b82c-265f574ea4a7 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:16.649114 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6c08c1bf-187f-4883-b82c-265f574ea4a7 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:16.649811 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6c08c1bf-187f-4883-b82c-265f574ea4a7 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:16.650261 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6c08c1bf-187f-4883-b82c-265f574ea4a7 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:16.657701 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6c08c1bf-187f-4883-b82c-265f574ea4a7 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:16.679502 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-6c08c1bf-187f-4883-b82c-265f574ea4a7 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044785 Aug 31 01:27:16.680058 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 279/565] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 01:27:16 2022] GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:27:16.834896 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [req-588e7cc0-a8b7-4e84-9c07-cdebaac88562 req-93c822a2-ff50-4c6a-8419-fb3413231335 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bee91462-f582-40c7-88f9-652f75ce8b01", "name": "network-vif-deleted", "tag": "81d2c012-27ea-4e66-96da-4c03afd30650"}]} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:27:16.851513 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-588e7cc0-a8b7-4e84-9c07-cdebaac88562 req-93c822a2-ff50-4c6a-8419-fb3413231335 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:16.852048 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-588e7cc0-a8b7-4e84-9c07-cdebaac88562 req-93c822a2-ff50-4c6a-8419-fb3413231335 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:16.852475 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-588e7cc0-a8b7-4e84-9c07-cdebaac88562 req-93c822a2-ff50-4c6a-8419-fb3413231335 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:16.863597 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.compute.server_external_events [req-588e7cc0-a8b7-4e84-9c07-cdebaac88562 req-93c822a2-ff50-4c6a-8419-fb3413231335 service nova] Creating event network-vif-deleted:81d2c012-27ea-4e66-96da-4c03afd30650 for instance bee91462-f582-40c7-88f9-652f75ce8b01 on hv-cinder-85528 Aug 31 01:27:16.869027 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [req-588e7cc0-a8b7-4e84-9c07-cdebaac88562 req-93c822a2-ff50-4c6a-8419-fb3413231335 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038646 Aug 31 01:27:16.869641 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 287/566] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:27:17.098574 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-4ed68452-3ae7-4ae7-b3b3-37d7ca4cb5e6 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:17.099102 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-4ed68452-3ae7-4ae7-b3b3-37d7ca4cb5e6 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:17.105158 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4ed68452-3ae7-4ae7-b3b3-37d7ca4cb5e6 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:17.105644 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4ed68452-3ae7-4ae7-b3b3-37d7ca4cb5e6 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:17.106072 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4ed68452-3ae7-4ae7-b3b3-37d7ca4cb5e6 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:17.106760 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4ed68452-3ae7-4ae7-b3b3-37d7ca4cb5e6 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:17.107208 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4ed68452-3ae7-4ae7-b3b3-37d7ca4cb5e6 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:17.107621 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4ed68452-3ae7-4ae7-b3b3-37d7ca4cb5e6 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:17.174272 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-4ed68452-3ae7-4ae7-b3b3-37d7ca4cb5e6 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:17.183168 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-4ed68452-3ae7-4ae7-b3b3-37d7ca4cb5e6 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 200 len: 1292 microversion: 2.1 time: 0.088460 Aug 31 01:27:17.183751 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 280/567] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:17 2022] GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 1292 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:27:17.692709 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-2ee41678-cc86-40cc-8225-6a610f7cbbc2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:17.695049 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-2ee41678-cc86-40cc-8225-6a610f7cbbc2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: acd1b630-d842-47ea-8019-f405c41ad7d3] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:17.701165 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-2ee41678-cc86-40cc-8225-6a610f7cbbc2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:17.702089 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-2ee41678-cc86-40cc-8225-6a610f7cbbc2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:17.702089 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-2ee41678-cc86-40cc-8225-6a610f7cbbc2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:17.702714 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-2ee41678-cc86-40cc-8225-6a610f7cbbc2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:17.703161 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-2ee41678-cc86-40cc-8225-6a610f7cbbc2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:17.703579 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-2ee41678-cc86-40cc-8225-6a610f7cbbc2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:17.733068 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-2ee41678-cc86-40cc-8225-6a610f7cbbc2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045035 Aug 31 01:27:17.733633 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 288/568] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 01:27:17 2022] GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 01:27:17.793866 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-ee3e216f-5c7c-4ece-ad60-64e9cf98e461 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:17.794421 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-ee3e216f-5c7c-4ece-ad60-64e9cf98e461 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: acd1b630-d842-47ea-8019-f405c41ad7d3] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:17.800647 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ee3e216f-5c7c-4ece-ad60-64e9cf98e461 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:17.801152 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ee3e216f-5c7c-4ece-ad60-64e9cf98e461 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:17.801578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ee3e216f-5c7c-4ece-ad60-64e9cf98e461 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:17.802257 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ee3e216f-5c7c-4ece-ad60-64e9cf98e461 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:17.802699 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ee3e216f-5c7c-4ece-ad60-64e9cf98e461 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:17.803115 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ee3e216f-5c7c-4ece-ad60-64e9cf98e461 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:17.820955 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:27:17.829377 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-ee3e216f-5c7c-4ece-ad60-64e9cf98e461 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: acd1b630-d842-47ea-8019-f405c41ad7d3] Going to try to terminate instance {{(pid=121025) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 01:27:18.204430 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-957f2394-0343-407a-8b15-6c2192d250b8 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:18.205077 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-957f2394-0343-407a-8b15-6c2192d250b8 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: bee91462-f582-40c7-88f9-652f75ce8b01] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:18.211832 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-957f2394-0343-407a-8b15-6c2192d250b8 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:18.212320 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-957f2394-0343-407a-8b15-6c2192d250b8 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:18.212781 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-957f2394-0343-407a-8b15-6c2192d250b8 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:18.213472 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-957f2394-0343-407a-8b15-6c2192d250b8 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:18.213929 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-957f2394-0343-407a-8b15-6c2192d250b8 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:18.214353 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-957f2394-0343-407a-8b15-6c2192d250b8 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:18.227396 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.wsgi [None req-957f2394-0343-407a-8b15-6c2192d250b8 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] HTTP exception thrown: Instance bee91462-f582-40c7-88f9-652f75ce8b01 could not be found. Aug 31 01:27:18.229067 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-957f2394-0343-407a-8b15-6c2192d250b8 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Request method failure captured: Aug 31 01:27:18.229067 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: request: GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 HTTP/1.1 Aug 31 01:27:18.229067 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept: application/json Aug 31 01:27:18.229067 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept-Encoding: identity Aug 31 01:27:18.229067 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Connection: close Aug 31 01:27:18.229067 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Length: 0 Aug 31 01:27:18.229067 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Type: application/json Aug 31 01:27:18.229067 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Host: 10.222.0.20 Aug 31 01:27:18.229067 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Openstack-System-Scope: None Aug 31 01:27:18.229067 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: User-Agent: python-urllib3/1.26.12 Aug 31 01:27:18.229067 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Auth-Token: gAAAAABjDrfcuhRqsMrMNTjo6mUtTq8SbDe9MkKQW1DPTn6rIQGU7H4zaD_aUkmczj_TdvdQczHlpInuXFz_PGsDLzVXnk0dWRrYAJmuB4iGkRs9-IEfWHKdmN10--_NmP9zX5MAawHt61YTHfjDuXxTKPEPlk6b4MU77kQiT6Ux_ynynzBaDZY Aug 31 01:27:18.229067 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Id: None Aug 31 01:27:18.229067 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Name: None Aug 31 01:27:18.229067 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Identity-Status: Confirmed Aug 31 01:27:18.229067 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Is-Admin-Project: True Aug 31 01:27:18.229067 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Id: default Aug 31 01:27:18.229067 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Name: Default Aug 31 01:27:18.229067 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Id: d58414b1dd2342d58cc7665aee50b86b Aug 31 01:27:18.229067 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2102440878 Aug 31 01:27:18.229067 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Role: member,reader Aug 31 01:27:18.229067 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Roles: member,reader Aug 31 01:27:18.230560 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d58414b1dd2342d58cc7665aee50b86b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d58414b1dd2342d58cc7665aee50b86b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d58414b1dd2342d58cc7665aee50b86b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d58414b1dd2342d58cc7665aee50b86b"}]}] Aug 31 01:27:18.230560 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2102440878 Aug 31 01:27:18.230560 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Id: d58414b1dd2342d58cc7665aee50b86b Aug 31 01:27:18.230560 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2102440878 Aug 31 01:27:18.230560 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User: tempest-ServerRescueNegativeTestJSON-2102440878-project Aug 31 01:27:18.230560 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Id: default Aug 31 01:27:18.230560 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Name: Default Aug 31 01:27:18.230560 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Id: 71d0408df86f4be0ac59cc80575a14e2 Aug 31 01:27:18.230560 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2102440878-project Aug 31 01:27:18.230560 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: method: > Aug 31 01:27:18.230560 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: exception: Instance bee91462-f582-40c7-88f9-652f75ce8b01 could not be found. Aug 31 01:27:18.230560 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: action_args: {'id': 'bee91462-f582-40c7-88f9-652f75ce8b01'} Aug 31 01:27:18.231389 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:27:18.231389 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:27:18.231389 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:27:18.231389 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:27:18.231389 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:27:18.231389 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:27:18.231389 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:27:18.231389 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:27:18.231389 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:27:18.231389 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:27:18.231389 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bee91462-f582-40c7-88f9-652f75ce8b01 could not be found. Aug 31 01:27:18.231389 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:27:18.231389 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:27:18.231389 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:27:18.231389 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:27:18.231389 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:27:18.231389 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:27:18.231389 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:27:18.231389 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:27:18.231389 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:27:18.232791 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:27:18.232791 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:27:18.232791 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:27:18.232791 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:27:18.232791 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:27:18.232791 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:27:18.232791 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:27:18.232791 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bee91462-f582-40c7-88f9-652f75ce8b01 could not be found. Aug 31 01:27:18.232791 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:27:18.232791 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:27:18.232791 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:27:18.232791 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:27:18.232791 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:27:18.232791 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:27:18.232791 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:27:18.232791 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:27:18.232791 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bee91462-f582-40c7-88f9-652f75ce8b01 could not be found. Aug 31 01:27:18.232791 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:27:18.234127 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-957f2394-0343-407a-8b15-6c2192d250b8 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Returning 404 to user: Instance bee91462-f582-40c7-88f9-652f75ce8b01 could not be found. {{(pid=121026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:27:18.234127 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-957f2394-0343-407a-8b15-6c2192d250b8 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01" status: 404 len: 111 microversion: 2.1 time: 0.030255 Aug 31 01:27:18.234127 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 289/569] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:18 2022] GET /compute/v2.1/servers/bee91462-f582-40c7-88f9-652f75ce8b01 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 01:27:18.238632 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-4d792fa4-80ca-4e1d-ae7f-ce2ef8d6b3ef tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:18.239114 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-4d792fa4-80ca-4e1d-ae7f-ce2ef8d6b3ef tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: ee6ca45e-29c7-4af8-8aef-72134f23292c] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:18.244878 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4d792fa4-80ca-4e1d-ae7f-ce2ef8d6b3ef tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:18.245355 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4d792fa4-80ca-4e1d-ae7f-ce2ef8d6b3ef tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:18.245792 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4d792fa4-80ca-4e1d-ae7f-ce2ef8d6b3ef tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:18.246479 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4d792fa4-80ca-4e1d-ae7f-ce2ef8d6b3ef tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:18.246930 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4d792fa4-80ca-4e1d-ae7f-ce2ef8d6b3ef tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:18.247348 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4d792fa4-80ca-4e1d-ae7f-ce2ef8d6b3ef tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:18.275021 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-4d792fa4-80ca-4e1d-ae7f-ce2ef8d6b3ef tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: ee6ca45e-29c7-4af8-8aef-72134f23292c] Going to try to terminate instance {{(pid=121026) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 01:27:18.403725 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-ee3e216f-5c7c-4ece-ad60-64e9cf98e461 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "DELETE /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3" status: 204 len: 0 microversion: 2.1 time: 0.613307 Aug 31 01:27:18.404315 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 281/570] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 01:27:17 2022] DELETE /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 01:27:18.412808 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-333b5254-a347-4b7c-b003-5cb7f351e170 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:18.413500 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-333b5254-a347-4b7c-b003-5cb7f351e170 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: acd1b630-d842-47ea-8019-f405c41ad7d3] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:18.419278 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-333b5254-a347-4b7c-b003-5cb7f351e170 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:18.419699 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-333b5254-a347-4b7c-b003-5cb7f351e170 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:18.420128 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-333b5254-a347-4b7c-b003-5cb7f351e170 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:18.420836 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-333b5254-a347-4b7c-b003-5cb7f351e170 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:18.421279 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-333b5254-a347-4b7c-b003-5cb7f351e170 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:18.421691 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-333b5254-a347-4b7c-b003-5cb7f351e170 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:18.555645 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-333b5254-a347-4b7c-b003-5cb7f351e170 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:18.563676 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-333b5254-a347-4b7c-b003-5cb7f351e170 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3" status: 200 len: 1680 microversion: 2.1 time: 0.154993 Aug 31 01:27:18.564247 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 282/571] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:18 2022] GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:27:18.751796 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-4d792fa4-80ca-4e1d-ae7f-ce2ef8d6b3ef tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c" status: 204 len: 0 microversion: 2.1 time: 0.516279 Aug 31 01:27:18.752788 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 290/572] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 01:27:18 2022] DELETE /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c => generated 0 bytes in 518 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 01:27:18.761467 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-418a4087-9922-44e8-82ca-54dbd24646f4 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:18.762014 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-418a4087-9922-44e8-82ca-54dbd24646f4 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: ee6ca45e-29c7-4af8-8aef-72134f23292c] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:18.768337 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-418a4087-9922-44e8-82ca-54dbd24646f4 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:18.768863 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-418a4087-9922-44e8-82ca-54dbd24646f4 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:18.769306 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-418a4087-9922-44e8-82ca-54dbd24646f4 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:18.769998 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-418a4087-9922-44e8-82ca-54dbd24646f4 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:18.770455 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-418a4087-9922-44e8-82ca-54dbd24646f4 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:18.770909 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-418a4087-9922-44e8-82ca-54dbd24646f4 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:18.898333 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-418a4087-9922-44e8-82ca-54dbd24646f4 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:18.906193 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-418a4087-9922-44e8-82ca-54dbd24646f4 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c" status: 200 len: 1522 microversion: 2.1 time: 0.148705 Aug 31 01:27:18.906761 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 283/573] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:18 2022] GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:27:19.586907 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-af2d1c15-cdd4-4399-9174-0b06017a5688 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:19.587603 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-af2d1c15-cdd4-4399-9174-0b06017a5688 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: acd1b630-d842-47ea-8019-f405c41ad7d3] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:19.593614 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-af2d1c15-cdd4-4399-9174-0b06017a5688 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:19.594091 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-af2d1c15-cdd4-4399-9174-0b06017a5688 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:19.594527 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-af2d1c15-cdd4-4399-9174-0b06017a5688 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:19.595209 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-af2d1c15-cdd4-4399-9174-0b06017a5688 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:19.595658 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-af2d1c15-cdd4-4399-9174-0b06017a5688 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:19.596074 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-af2d1c15-cdd4-4399-9174-0b06017a5688 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:19.725236 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-af2d1c15-cdd4-4399-9174-0b06017a5688 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:19.732816 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-af2d1c15-cdd4-4399-9174-0b06017a5688 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3" status: 200 len: 1680 microversion: 2.1 time: 0.150692 Aug 31 01:27:19.733376 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 291/574] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:19 2022] GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:27:19.926617 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-7a993334-345d-4326-ae36-58f06d7ad731 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:19.927733 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-7a993334-345d-4326-ae36-58f06d7ad731 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: ee6ca45e-29c7-4af8-8aef-72134f23292c] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:19.934068 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7a993334-345d-4326-ae36-58f06d7ad731 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:19.934547 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7a993334-345d-4326-ae36-58f06d7ad731 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:19.934981 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7a993334-345d-4326-ae36-58f06d7ad731 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:19.935852 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7a993334-345d-4326-ae36-58f06d7ad731 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:19.936307 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7a993334-345d-4326-ae36-58f06d7ad731 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:19.936746 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7a993334-345d-4326-ae36-58f06d7ad731 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:20.067270 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-7a993334-345d-4326-ae36-58f06d7ad731 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:20.075861 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-7a993334-345d-4326-ae36-58f06d7ad731 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c" status: 200 len: 1522 microversion: 2.1 time: 0.153185 Aug 31 01:27:20.076416 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 284/575] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:19 2022] GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:27:20.752835 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-68239d5f-f8bb-4694-9ae8-114e890d23b8 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:20.753529 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-68239d5f-f8bb-4694-9ae8-114e890d23b8 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: acd1b630-d842-47ea-8019-f405c41ad7d3] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:20.760203 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-68239d5f-f8bb-4694-9ae8-114e890d23b8 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:20.760684 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-68239d5f-f8bb-4694-9ae8-114e890d23b8 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:20.761152 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-68239d5f-f8bb-4694-9ae8-114e890d23b8 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:20.761840 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-68239d5f-f8bb-4694-9ae8-114e890d23b8 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:20.762292 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-68239d5f-f8bb-4694-9ae8-114e890d23b8 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:20.762750 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-68239d5f-f8bb-4694-9ae8-114e890d23b8 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:20.889551 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-68239d5f-f8bb-4694-9ae8-114e890d23b8 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:20.897767 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-68239d5f-f8bb-4694-9ae8-114e890d23b8 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3" status: 200 len: 1680 microversion: 2.1 time: 0.148844 Aug 31 01:27:20.898616 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 292/576] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:20 2022] GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:27:21.096956 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-d5d06a42-8f1c-47cd-bb8e-820f71670504 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:21.097490 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-d5d06a42-8f1c-47cd-bb8e-820f71670504 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: ee6ca45e-29c7-4af8-8aef-72134f23292c] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:21.103907 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d5d06a42-8f1c-47cd-bb8e-820f71670504 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:21.104384 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d5d06a42-8f1c-47cd-bb8e-820f71670504 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:21.104843 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d5d06a42-8f1c-47cd-bb8e-820f71670504 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:21.105530 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d5d06a42-8f1c-47cd-bb8e-820f71670504 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:21.105979 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d5d06a42-8f1c-47cd-bb8e-820f71670504 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:21.106394 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d5d06a42-8f1c-47cd-bb8e-820f71670504 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:21.235063 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-d5d06a42-8f1c-47cd-bb8e-820f71670504 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:21.242600 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-d5d06a42-8f1c-47cd-bb8e-820f71670504 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c" status: 200 len: 1522 microversion: 2.1 time: 0.149701 Aug 31 01:27:21.243163 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 285/577] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:21 2022] GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:27:21.918838 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-87ee5f3e-e50a-4810-98d8-16e8fe825ec8 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:21.919444 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-87ee5f3e-e50a-4810-98d8-16e8fe825ec8 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: acd1b630-d842-47ea-8019-f405c41ad7d3] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:21.925947 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-87ee5f3e-e50a-4810-98d8-16e8fe825ec8 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:21.926434 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-87ee5f3e-e50a-4810-98d8-16e8fe825ec8 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:21.926870 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-87ee5f3e-e50a-4810-98d8-16e8fe825ec8 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:21.928185 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-87ee5f3e-e50a-4810-98d8-16e8fe825ec8 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:21.928639 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-87ee5f3e-e50a-4810-98d8-16e8fe825ec8 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:21.929089 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-87ee5f3e-e50a-4810-98d8-16e8fe825ec8 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:22.053861 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-87ee5f3e-e50a-4810-98d8-16e8fe825ec8 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:22.061544 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-87ee5f3e-e50a-4810-98d8-16e8fe825ec8 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3" status: 200 len: 1680 microversion: 2.1 time: 0.146538 Aug 31 01:27:22.062113 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 293/578] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:21 2022] GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3 => generated 1680 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:27:22.263094 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-ce561a91-ce02-46cd-9e96-28c5416d2637 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:22.263710 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-ce561a91-ce02-46cd-9e96-28c5416d2637 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: ee6ca45e-29c7-4af8-8aef-72134f23292c] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:22.270107 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ce561a91-ce02-46cd-9e96-28c5416d2637 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:22.271065 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ce561a91-ce02-46cd-9e96-28c5416d2637 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:22.271502 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ce561a91-ce02-46cd-9e96-28c5416d2637 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:22.272186 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ce561a91-ce02-46cd-9e96-28c5416d2637 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:22.272632 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ce561a91-ce02-46cd-9e96-28c5416d2637 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:22.273078 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ce561a91-ce02-46cd-9e96-28c5416d2637 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:22.554016 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-ce561a91-ce02-46cd-9e96-28c5416d2637 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:22.561756 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-ce561a91-ce02-46cd-9e96-28c5416d2637 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c" status: 200 len: 1522 microversion: 2.1 time: 0.302514 Aug 31 01:27:22.562321 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 286/579] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:22 2022] GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:27:23.083237 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-7463a10c-5ffa-4711-948b-1a8925d953da tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:23.083848 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-7463a10c-5ffa-4711-948b-1a8925d953da tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: acd1b630-d842-47ea-8019-f405c41ad7d3] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:23.090037 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7463a10c-5ffa-4711-948b-1a8925d953da tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:23.090514 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7463a10c-5ffa-4711-948b-1a8925d953da tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:23.090943 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7463a10c-5ffa-4711-948b-1a8925d953da tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:23.091628 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7463a10c-5ffa-4711-948b-1a8925d953da tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:23.092072 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7463a10c-5ffa-4711-948b-1a8925d953da tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:23.092493 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7463a10c-5ffa-4711-948b-1a8925d953da tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:23.110232 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:27:23.377375 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-7463a10c-5ffa-4711-948b-1a8925d953da tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:23.385658 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-7463a10c-5ffa-4711-948b-1a8925d953da tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3" status: 200 len: 1680 microversion: 2.1 time: 0.306494 Aug 31 01:27:23.386344 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 294/580] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:23 2022] GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3 => generated 1680 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:27:23.584322 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-f8d05f0b-a035-4779-bd11-3fb2574026ce tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:23.584972 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-f8d05f0b-a035-4779-bd11-3fb2574026ce tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: ee6ca45e-29c7-4af8-8aef-72134f23292c] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:23.591923 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f8d05f0b-a035-4779-bd11-3fb2574026ce tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:23.592419 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f8d05f0b-a035-4779-bd11-3fb2574026ce tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:23.593290 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f8d05f0b-a035-4779-bd11-3fb2574026ce tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:23.594141 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f8d05f0b-a035-4779-bd11-3fb2574026ce tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:23.594592 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f8d05f0b-a035-4779-bd11-3fb2574026ce tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:23.595022 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f8d05f0b-a035-4779-bd11-3fb2574026ce tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:23.786081 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-f8d05f0b-a035-4779-bd11-3fb2574026ce tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:23.798518 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-f8d05f0b-a035-4779-bd11-3fb2574026ce tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c" status: 200 len: 1522 microversion: 2.1 time: 0.219008 Aug 31 01:27:23.808212 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 287/581] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:23 2022] GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:27:23.868671 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [req-88fc0f21-d2d5-4865-97d8-dadd5ede4543 req-c1ed69a3-12e7-4636-8a98-53acefa25151 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee6ca45e-29c7-4af8-8aef-72134f23292c", "name": "network-vif-deleted", "tag": "388de9da-77e7-4d40-9542-da91eb9630e0"}]} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:27:23.878244 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-88fc0f21-d2d5-4865-97d8-dadd5ede4543 req-c1ed69a3-12e7-4636-8a98-53acefa25151 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:23.878717 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-88fc0f21-d2d5-4865-97d8-dadd5ede4543 req-c1ed69a3-12e7-4636-8a98-53acefa25151 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:23.879146 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-88fc0f21-d2d5-4865-97d8-dadd5ede4543 req-c1ed69a3-12e7-4636-8a98-53acefa25151 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:23.891323 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.compute.server_external_events [req-88fc0f21-d2d5-4865-97d8-dadd5ede4543 req-c1ed69a3-12e7-4636-8a98-53acefa25151 service nova] Creating event network-vif-deleted:388de9da-77e7-4d40-9542-da91eb9630e0 for instance ee6ca45e-29c7-4af8-8aef-72134f23292c on hv-cinder-85528 Aug 31 01:27:23.896410 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [req-88fc0f21-d2d5-4865-97d8-dadd5ede4543 req-c1ed69a3-12e7-4636-8a98-53acefa25151 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031872 Aug 31 01:27:23.897046 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 295/582] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:27:24.216021 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-c663190f-6b5c-47cc-a4d0-2e90c244ef78 req-8e4f4b9b-bdfc-4442-9dd8-d85044dd61f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acd1b630-d842-47ea-8019-f405c41ad7d3", "name": "network-vif-deleted", "tag": "56319e02-73a5-4ec7-acf3-90f2592a466e"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:27:24.227857 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-c663190f-6b5c-47cc-a4d0-2e90c244ef78 req-8e4f4b9b-bdfc-4442-9dd8-d85044dd61f8 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:24.228892 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-c663190f-6b5c-47cc-a4d0-2e90c244ef78 req-8e4f4b9b-bdfc-4442-9dd8-d85044dd61f8 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:24.229488 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-c663190f-6b5c-47cc-a4d0-2e90c244ef78 req-8e4f4b9b-bdfc-4442-9dd8-d85044dd61f8 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:24.244210 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-c663190f-6b5c-47cc-a4d0-2e90c244ef78 req-8e4f4b9b-bdfc-4442-9dd8-d85044dd61f8 service nova] Creating event network-vif-deleted:56319e02-73a5-4ec7-acf3-90f2592a466e for instance acd1b630-d842-47ea-8019-f405c41ad7d3 on hv-cinder-85528 Aug 31 01:27:24.250062 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-c663190f-6b5c-47cc-a4d0-2e90c244ef78 req-8e4f4b9b-bdfc-4442-9dd8-d85044dd61f8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039342 Aug 31 01:27:24.250668 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 288/583] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:27:24.407646 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-868584af-e733-4de2-a0f3-7fcb93bc3913 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:24.408452 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-868584af-e733-4de2-a0f3-7fcb93bc3913 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: acd1b630-d842-47ea-8019-f405c41ad7d3] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:24.416234 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-868584af-e733-4de2-a0f3-7fcb93bc3913 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:24.419063 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-868584af-e733-4de2-a0f3-7fcb93bc3913 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:24.421546 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-868584af-e733-4de2-a0f3-7fcb93bc3913 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:24.422567 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-868584af-e733-4de2-a0f3-7fcb93bc3913 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:24.423256 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-868584af-e733-4de2-a0f3-7fcb93bc3913 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:24.423917 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-868584af-e733-4de2-a0f3-7fcb93bc3913 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:24.498441 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-868584af-e733-4de2-a0f3-7fcb93bc3913 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:24.509235 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-868584af-e733-4de2-a0f3-7fcb93bc3913 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3" status: 200 len: 1326 microversion: 2.1 time: 0.104904 Aug 31 01:27:24.510193 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 296/584] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:24 2022] GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3 => generated 1326 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:27:24.820140 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-38720c64-9f13-43bb-9ca1-37cf563dd475 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:24.820901 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-38720c64-9f13-43bb-9ca1-37cf563dd475 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: ee6ca45e-29c7-4af8-8aef-72134f23292c] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:24.828075 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-38720c64-9f13-43bb-9ca1-37cf563dd475 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:24.829305 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-38720c64-9f13-43bb-9ca1-37cf563dd475 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:24.829940 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-38720c64-9f13-43bb-9ca1-37cf563dd475 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:24.830850 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-38720c64-9f13-43bb-9ca1-37cf563dd475 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:24.831616 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-38720c64-9f13-43bb-9ca1-37cf563dd475 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:24.832191 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-38720c64-9f13-43bb-9ca1-37cf563dd475 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:24.869017 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-38720c64-9f13-43bb-9ca1-37cf563dd475 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:24.869577 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-38720c64-9f13-43bb-9ca1-37cf563dd475 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:24.870013 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-38720c64-9f13-43bb-9ca1-37cf563dd475 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:24.870449 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.objects.instance [None req-38720c64-9f13-43bb-9ca1-37cf563dd475 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lazy-loading 'fault' on Instance uuid ee6ca45e-29c7-4af8-8aef-72134f23292c {{(pid=121025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:27:24.922281 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-38720c64-9f13-43bb-9ca1-37cf563dd475 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0408df86f4be0ac59cc80575a14e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58414b1dd2342d58cc7665aee50b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:24.931297 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-38720c64-9f13-43bb-9ca1-37cf563dd475 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c" status: 200 len: 1311 microversion: 2.1 time: 0.114836 Aug 31 01:27:24.931566 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 289/585] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:24 2022] GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c => generated 1311 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:27:25.530990 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-081eca59-b326-4a78-ae6e-e12919941c4d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:25.531595 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-081eca59-b326-4a78-ae6e-e12919941c4d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: acd1b630-d842-47ea-8019-f405c41ad7d3] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:25.538131 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-081eca59-b326-4a78-ae6e-e12919941c4d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:25.538612 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-081eca59-b326-4a78-ae6e-e12919941c4d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:25.539044 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-081eca59-b326-4a78-ae6e-e12919941c4d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:25.539753 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-081eca59-b326-4a78-ae6e-e12919941c4d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:25.540197 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-081eca59-b326-4a78-ae6e-e12919941c4d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:25.540612 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-081eca59-b326-4a78-ae6e-e12919941c4d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:25.555574 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.wsgi [None req-081eca59-b326-4a78-ae6e-e12919941c4d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] HTTP exception thrown: Instance acd1b630-d842-47ea-8019-f405c41ad7d3 could not be found. Aug 31 01:27:25.557237 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-081eca59-b326-4a78-ae6e-e12919941c4d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Request method failure captured: Aug 31 01:27:25.557237 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: request: GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3 HTTP/1.1 Aug 31 01:27:25.557237 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept: application/json Aug 31 01:27:25.557237 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept-Encoding: identity Aug 31 01:27:25.557237 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Connection: close Aug 31 01:27:25.557237 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Length: 0 Aug 31 01:27:25.557237 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Type: application/json Aug 31 01:27:25.557237 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Host: 10.222.0.20 Aug 31 01:27:25.557237 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Openstack-System-Scope: None Aug 31 01:27:25.557237 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: User-Agent: python-urllib3/1.26.12 Aug 31 01:27:25.557237 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Auth-Token: gAAAAABjDrfet2Sy4N8jKKJoN7i8trLl0KW7DYiW5JhaLj0L5xpx8IJJDKjwB1T51gnweVtzcKX7Vmb1NaayoFFPtTaITD4WxtfyhSUUM3_4_aZ5GptnzhJmrFo6ZwSNdxq7_gCewRQsJwS99WXQ3X8vSLGTrSznkbNFB8yNJvuQw_w6CXmffXc Aug 31 01:27:25.557237 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Id: None Aug 31 01:27:25.557237 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Name: None Aug 31 01:27:25.557237 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Identity-Status: Confirmed Aug 31 01:27:25.557237 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Is-Admin-Project: True Aug 31 01:27:25.557237 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Id: default Aug 31 01:27:25.557237 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Name: Default Aug 31 01:27:25.557237 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Id: 164da7d4776d4e9f8cf6497aa784d312 Aug 31 01:27:25.557237 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Name: tempest-AttachVolumeNegativeTest-1582720348 Aug 31 01:27:25.557237 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Role: member,reader Aug 31 01:27:25.557237 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Roles: member,reader Aug 31 01:27:25.558731 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/164da7d4776d4e9f8cf6497aa784d312"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_164da7d4776d4e9f8cf6497aa784d312", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/164da7d4776d4e9f8cf6497aa784d312"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/164da7d4776d4e9f8cf6497aa784d312"}]}] Aug 31 01:27:25.558731 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant: tempest-AttachVolumeNegativeTest-1582720348 Aug 31 01:27:25.558731 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Id: 164da7d4776d4e9f8cf6497aa784d312 Aug 31 01:27:25.558731 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1582720348 Aug 31 01:27:25.558731 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User: tempest-AttachVolumeNegativeTest-1582720348-project Aug 31 01:27:25.558731 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Id: default Aug 31 01:27:25.558731 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Name: Default Aug 31 01:27:25.558731 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Id: 52ed99737fd240789bb682fd9bf11be3 Aug 31 01:27:25.558731 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Name: tempest-AttachVolumeNegativeTest-1582720348-project Aug 31 01:27:25.558731 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: method: > Aug 31 01:27:25.558731 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: exception: Instance acd1b630-d842-47ea-8019-f405c41ad7d3 could not be found. Aug 31 01:27:25.558731 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: action_args: {'id': 'acd1b630-d842-47ea-8019-f405c41ad7d3'} Aug 31 01:27:25.562856 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:27:25.562856 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:27:25.562856 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:27:25.562856 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:27:25.562856 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:27:25.562856 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:27:25.562856 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:27:25.562856 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:27:25.562856 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:27:25.562856 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:27:25.562856 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acd1b630-d842-47ea-8019-f405c41ad7d3 could not be found. Aug 31 01:27:25.562856 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:27:25.562856 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:27:25.562856 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:27:25.562856 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:27:25.562856 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:27:25.562856 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:27:25.562856 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:27:25.562856 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:27:25.562856 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:27:25.564228 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:27:25.564228 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:27:25.564228 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:27:25.564228 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:27:25.564228 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:27:25.564228 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:27:25.564228 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:27:25.564228 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acd1b630-d842-47ea-8019-f405c41ad7d3 could not be found. Aug 31 01:27:25.564228 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:27:25.564228 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:27:25.564228 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:27:25.564228 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:27:25.564228 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:27:25.564228 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:27:25.564228 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:27:25.564228 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:27:25.564228 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acd1b630-d842-47ea-8019-f405c41ad7d3 could not be found. Aug 31 01:27:25.564228 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:27:25.565531 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-081eca59-b326-4a78-ae6e-e12919941c4d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Returning 404 to user: Instance acd1b630-d842-47ea-8019-f405c41ad7d3 could not be found. {{(pid=121026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:27:25.565531 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-081eca59-b326-4a78-ae6e-e12919941c4d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3" status: 404 len: 111 microversion: 2.1 time: 0.031600 Aug 31 01:27:25.565531 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 297/586] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:25 2022] GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:27:25.568089 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-1e05810f-16e3-4eed-80b3-84851f49f3d5 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '.version_select at 0x7f1fe18471f0>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:25.671356 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-1e05810f-16e3-4eed-80b3-84851f49f3d5 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1527051928" status: 202 len: 0 microversion: 2.1 time: 0.107624 Aug 31 01:27:25.677878 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 290/587] 10.222.0.20 () {58 vars in 1221 bytes} [Wed Aug 31 01:27:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1527051928 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 01:27:25.952898 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-815fbd98-f924-4505-96c2-110b1c230503 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:25.953423 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-815fbd98-f924-4505-96c2-110b1c230503 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] [instance: ee6ca45e-29c7-4af8-8aef-72134f23292c] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:25.959825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-815fbd98-f924-4505-96c2-110b1c230503 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:25.960306 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-815fbd98-f924-4505-96c2-110b1c230503 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:25.960750 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-815fbd98-f924-4505-96c2-110b1c230503 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:25.961443 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-815fbd98-f924-4505-96c2-110b1c230503 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:25.961888 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-815fbd98-f924-4505-96c2-110b1c230503 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:25.962304 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-815fbd98-f924-4505-96c2-110b1c230503 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:25.975616 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.wsgi [None req-815fbd98-f924-4505-96c2-110b1c230503 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] HTTP exception thrown: Instance ee6ca45e-29c7-4af8-8aef-72134f23292c could not be found. Aug 31 01:27:25.977176 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-815fbd98-f924-4505-96c2-110b1c230503 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Request method failure captured: Aug 31 01:27:25.977176 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: request: GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c HTTP/1.1 Aug 31 01:27:25.977176 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept: application/json Aug 31 01:27:25.977176 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept-Encoding: identity Aug 31 01:27:25.977176 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Connection: close Aug 31 01:27:25.977176 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Length: 0 Aug 31 01:27:25.977176 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Type: application/json Aug 31 01:27:25.977176 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Host: 10.222.0.20 Aug 31 01:27:25.977176 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Openstack-System-Scope: None Aug 31 01:27:25.977176 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: User-Agent: python-urllib3/1.26.12 Aug 31 01:27:25.977176 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Auth-Token: gAAAAABjDrfcuhRqsMrMNTjo6mUtTq8SbDe9MkKQW1DPTn6rIQGU7H4zaD_aUkmczj_TdvdQczHlpInuXFz_PGsDLzVXnk0dWRrYAJmuB4iGkRs9-IEfWHKdmN10--_NmP9zX5MAawHt61YTHfjDuXxTKPEPlk6b4MU77kQiT6Ux_ynynzBaDZY Aug 31 01:27:25.977176 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Id: None Aug 31 01:27:25.977176 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Name: None Aug 31 01:27:25.977176 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Identity-Status: Confirmed Aug 31 01:27:25.977176 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Is-Admin-Project: True Aug 31 01:27:25.977176 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Id: default Aug 31 01:27:25.977176 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Name: Default Aug 31 01:27:25.977176 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Id: d58414b1dd2342d58cc7665aee50b86b Aug 31 01:27:25.977176 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2102440878 Aug 31 01:27:25.977176 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Role: member,reader Aug 31 01:27:25.977176 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Roles: member,reader Aug 31 01:27:25.978746 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d58414b1dd2342d58cc7665aee50b86b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d58414b1dd2342d58cc7665aee50b86b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d58414b1dd2342d58cc7665aee50b86b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d58414b1dd2342d58cc7665aee50b86b"}]}] Aug 31 01:27:25.978746 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2102440878 Aug 31 01:27:25.978746 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Id: d58414b1dd2342d58cc7665aee50b86b Aug 31 01:27:25.978746 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2102440878 Aug 31 01:27:25.978746 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User: tempest-ServerRescueNegativeTestJSON-2102440878-project Aug 31 01:27:25.978746 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Id: default Aug 31 01:27:25.978746 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Name: Default Aug 31 01:27:25.978746 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Id: 71d0408df86f4be0ac59cc80575a14e2 Aug 31 01:27:25.978746 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2102440878-project Aug 31 01:27:25.978746 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: method: > Aug 31 01:27:25.978746 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: exception: Instance ee6ca45e-29c7-4af8-8aef-72134f23292c could not be found. Aug 31 01:27:25.978746 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: action_args: {'id': 'ee6ca45e-29c7-4af8-8aef-72134f23292c'} Aug 31 01:27:25.982599 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:27:25.982599 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:27:25.982599 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:27:25.982599 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:27:25.982599 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:27:25.982599 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:27:25.982599 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:27:25.982599 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:27:25.982599 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:27:25.982599 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:27:25.982599 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee6ca45e-29c7-4af8-8aef-72134f23292c could not be found. Aug 31 01:27:25.982599 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:27:25.982599 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:27:25.982599 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:27:25.982599 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:27:25.982599 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:27:25.982599 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:27:25.982599 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:27:25.982599 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:27:25.982599 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:27:25.984109 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:27:25.984109 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:27:25.984109 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:27:25.984109 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:27:25.984109 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:27:25.984109 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:27:25.984109 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:27:25.984109 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee6ca45e-29c7-4af8-8aef-72134f23292c could not be found. Aug 31 01:27:25.984109 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:27:25.984109 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:27:25.984109 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:27:25.984109 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:27:25.984109 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:27:25.984109 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:27:25.984109 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:27:25.984109 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:27:25.984109 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee6ca45e-29c7-4af8-8aef-72134f23292c could not be found. Aug 31 01:27:25.984109 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:27:25.985472 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-815fbd98-f924-4505-96c2-110b1c230503 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] Returning 404 to user: Instance ee6ca45e-29c7-4af8-8aef-72134f23292c could not be found. {{(pid=121026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:27:25.985472 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-815fbd98-f924-4505-96c2-110b1c230503 tempest-ServerRescueNegativeTestJSON-2102440878 tempest-ServerRescueNegativeTestJSON-2102440878-project] 10.222.0.20 "GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c" status: 404 len: 111 microversion: 2.1 time: 0.029681 Aug 31 01:27:25.985472 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 298/588] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:25 2022] GET /compute/v2.1/servers/ee6ca45e-29c7-4af8-8aef-72134f23292c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:27:27.014229 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-ef1b489e-22dd-4924-8d2f-9b748fb54334 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Action: 'create', calling method: .version_select at 0x7f1fe15ed310>, body: {"keypair": {"name": "tempest-keypair-860954878", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcM6YXdD7XV/Pf3wwiP/z23zGbW9hVUU7GizIVWPy4Ly+Cg9cmv3dj8/0Gdb47snPx+wpfZPFDQybh4kjgp4od0AkytcI30TD7WoebuCnZNkQFfgA16XpdIq+U6Ax1nmg=="}} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:27:27.031502 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.quota [None req-ef1b489e-22dd-4924-8d2f-9b748fb54334 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Getting quotas for project 164da7d4776d4e9f8cf6497aa784d312. Resources: {'key_pairs'} {{(pid=121025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 01:27:27.035368 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.quota [None req-ef1b489e-22dd-4924-8d2f-9b748fb54334 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Getting quotas for user 52ed99737fd240789bb682fd9bf11be3 and project 164da7d4776d4e9f8cf6497aa784d312. Resources: {'key_pairs'} {{(pid=121025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 01:27:27.141274 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-ef1b489e-22dd-4924-8d2f-9b748fb54334 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.131319 Aug 31 01:27:27.141923 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 291/589] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Aug 31 01:27:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:27:27.641739 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-31051546-0635-40bd-8272-6e2cd3af49c1 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:27.644746 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-31051546-0635-40bd-8272-6e2cd3af49c1 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:27.659397 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-31051546-0635-40bd-8272-6e2cd3af49c1 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:27.660269 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-31051546-0635-40bd-8272-6e2cd3af49c1 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:27.660921 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-31051546-0635-40bd-8272-6e2cd3af49c1 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:27.661857 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-31051546-0635-40bd-8272-6e2cd3af49c1 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:27.662612 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-31051546-0635-40bd-8272-6e2cd3af49c1 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:27.664011 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-31051546-0635-40bd-8272-6e2cd3af49c1 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:27.713628 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-31051546-0635-40bd-8272-6e2cd3af49c1 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076079 Aug 31 01:27:27.720401 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 299/590] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 01:27:27 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 01:27:27.788259 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-fab5fd09-619d-4d71-828c-bc2e206148c8 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:27.788787 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-fab5fd09-619d-4d71-828c-bc2e206148c8 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:27.795296 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fab5fd09-619d-4d71-828c-bc2e206148c8 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:27.795800 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fab5fd09-619d-4d71-828c-bc2e206148c8 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:27.796250 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fab5fd09-619d-4d71-828c-bc2e206148c8 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:27.797008 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fab5fd09-619d-4d71-828c-bc2e206148c8 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:27.797467 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fab5fd09-619d-4d71-828c-bc2e206148c8 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:27.797900 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fab5fd09-619d-4d71-828c-bc2e206148c8 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:27.835535 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-fab5fd09-619d-4d71-828c-bc2e206148c8 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Going to try to terminate instance {{(pid=121025) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 01:27:28.180938 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-fab5fd09-619d-4d71-828c-bc2e206148c8 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "DELETE /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 204 len: 0 microversion: 2.1 time: 0.396772 Aug 31 01:27:28.183426 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 292/591] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 01:27:27 2022] DELETE /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 01:27:28.190041 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-a47d7673-1dec-453d-ba2c-36cdabb2264b tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:28.190645 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-a47d7673-1dec-453d-ba2c-36cdabb2264b tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:28.196554 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a47d7673-1dec-453d-ba2c-36cdabb2264b tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:28.197067 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a47d7673-1dec-453d-ba2c-36cdabb2264b tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:28.198514 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a47d7673-1dec-453d-ba2c-36cdabb2264b tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:28.198514 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a47d7673-1dec-453d-ba2c-36cdabb2264b tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:28.198691 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a47d7673-1dec-453d-ba2c-36cdabb2264b tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:28.199130 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a47d7673-1dec-453d-ba2c-36cdabb2264b tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:28.387367 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-a47d7673-1dec-453d-ba2c-36cdabb2264b tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:28.409066 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-a47d7673-1dec-453d-ba2c-36cdabb2264b tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1674 microversion: 2.1 time: 0.217016 Aug 31 01:27:28.409985 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 300/592] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:28 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1674 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:27:29.433963 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-5472aac5-7820-499e-908f-b5494ada96a9 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:29.438438 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-5472aac5-7820-499e-908f-b5494ada96a9 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:29.446572 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5472aac5-7820-499e-908f-b5494ada96a9 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:29.447532 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5472aac5-7820-499e-908f-b5494ada96a9 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:29.448459 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5472aac5-7820-499e-908f-b5494ada96a9 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:29.449629 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5472aac5-7820-499e-908f-b5494ada96a9 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:29.450422 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5472aac5-7820-499e-908f-b5494ada96a9 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:29.451095 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5472aac5-7820-499e-908f-b5494ada96a9 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:29.685431 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-5472aac5-7820-499e-908f-b5494ada96a9 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:29.694327 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-5472aac5-7820-499e-908f-b5494ada96a9 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1674 microversion: 2.1 time: 0.265825 Aug 31 01:27:29.695319 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 293/593] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:29 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1674 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:27:30.243681 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-1c4c4fcf-8e83-4934-b6f9-b41b2edb9117 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-616950726", "imageRef": "ed6d3236-defa-4ccf-90ba-343c0d0ad58e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0760f9a5-d813-4a0f-bcef-9988cda0c948"}], "security_groups": [{"name": "tempest-securitygroup--1014487093"}], "key_name": "tempest-keypair-860954878", "user_data": "}} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:27:30.497212 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.network.neutron [None req-1c4c4fcf-8e83-4934-b6f9-b41b2edb9117 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] validate_networks() for [('0760f9a5-d813-4a0f-bcef-9988cda0c948', None, None, None, None, None)] {{(pid=121026) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 01:27:30.715505 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-686874cb-b2d0-4dee-8ce6-9f06fa5d06fb tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:30.716144 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-686874cb-b2d0-4dee-8ce6-9f06fa5d06fb tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:30.723082 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-686874cb-b2d0-4dee-8ce6-9f06fa5d06fb tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:30.724144 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-686874cb-b2d0-4dee-8ce6-9f06fa5d06fb tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:30.724579 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-686874cb-b2d0-4dee-8ce6-9f06fa5d06fb tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:30.725306 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-686874cb-b2d0-4dee-8ce6-9f06fa5d06fb tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:30.725764 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-686874cb-b2d0-4dee-8ce6-9f06fa5d06fb tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:30.726184 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-686874cb-b2d0-4dee-8ce6-9f06fa5d06fb tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:31.172526 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-686874cb-b2d0-4dee-8ce6-9f06fa5d06fb tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:31.180940 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-686874cb-b2d0-4dee-8ce6-9f06fa5d06fb tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1674 microversion: 2.1 time: 0.469253 Aug 31 01:27:31.181844 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 294/594] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:30 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1674 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:27:31.404613 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.virt.hardware [None req-1c4c4fcf-8e83-4934-b6f9-b41b2edb9117 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Flavor limits 0:0:0 {{(pid=121026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 01:27:31.405111 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.virt.hardware [None req-1c4c4fcf-8e83-4934-b6f9-b41b2edb9117 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Image limits 0:0:0 {{(pid=121026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 01:27:31.405505 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.virt.hardware [None req-1c4c4fcf-8e83-4934-b6f9-b41b2edb9117 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Flavor pref 0:0:0 {{(pid=121026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 01:27:31.406257 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.virt.hardware [None req-1c4c4fcf-8e83-4934-b6f9-b41b2edb9117 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Image pref 0:0:0 {{(pid=121026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 01:27:31.406874 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.virt.hardware [None req-1c4c4fcf-8e83-4934-b6f9-b41b2edb9117 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 01:27:31.416201 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1c4c4fcf-8e83-4934-b6f9-b41b2edb9117 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:31.417142 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1c4c4fcf-8e83-4934-b6f9-b41b2edb9117 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:31.417704 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1c4c4fcf-8e83-4934-b6f9-b41b2edb9117 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:31.418396 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1c4c4fcf-8e83-4934-b6f9-b41b2edb9117 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:31.418841 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1c4c4fcf-8e83-4934-b6f9-b41b2edb9117 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:31.419252 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1c4c4fcf-8e83-4934-b6f9-b41b2edb9117 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:31.436429 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.quota [None req-1c4c4fcf-8e83-4934-b6f9-b41b2edb9117 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Getting quotas for project 164da7d4776d4e9f8cf6497aa784d312. Resources: {'instances', 'cores', 'ram'} {{(pid=121026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 01:27:31.440527 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.quota [None req-1c4c4fcf-8e83-4934-b6f9-b41b2edb9117 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Getting quotas for user 52ed99737fd240789bb682fd9bf11be3 and project 164da7d4776d4e9f8cf6497aa784d312. Resources: {'instances', 'cores', 'ram'} {{(pid=121026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 01:27:31.454411 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-1c4c4fcf-8e83-4934-b6f9-b41b2edb9117 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Going to run 1 instances... {{(pid=121026) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 01:27:31.456688 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-1c4c4fcf-8e83-4934-b6f9-b41b2edb9117 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ed6d3236-defa-4ccf-90ba-343c0d0ad58e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121026) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 01:27:31.563007 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-1c4c4fcf-8e83-4934-b6f9-b41b2edb9117 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.324469 Aug 31 01:27:31.563963 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 301/595] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 31 01:27:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 1326 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 01:27:31.574954 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-12bfd491-e321-4028-9325-a88d0a44e817 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:31.575550 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-12bfd491-e321-4028-9325-a88d0a44e817 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:31.656759 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-12bfd491-e321-4028-9325-a88d0a44e817 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:31.673219 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-12bfd491-e321-4028-9325-a88d0a44e817 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac" status: 200 len: 1240 microversion: 2.1 time: 0.098290 Aug 31 01:27:31.673219 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 295/596] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:31 2022] GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac => generated 1240 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:27:31.847836 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [req-3ad56061-9fa3-40f7-860e-8d60914a393d req-32e919be-f50e-49d0-8c43-6f3156ee87f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "368bac0a-39c9-4f1e-99f9-84223e7de06b", "name": "network-vif-deleted", "tag": "51441d6e-84dd-48a3-bd25-fade9ebd6634"}]} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:27:31.860111 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-3ad56061-9fa3-40f7-860e-8d60914a393d req-32e919be-f50e-49d0-8c43-6f3156ee87f3 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:31.860778 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-3ad56061-9fa3-40f7-860e-8d60914a393d req-32e919be-f50e-49d0-8c43-6f3156ee87f3 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:31.861517 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-3ad56061-9fa3-40f7-860e-8d60914a393d req-32e919be-f50e-49d0-8c43-6f3156ee87f3 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:31.875273 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.compute.server_external_events [req-3ad56061-9fa3-40f7-860e-8d60914a393d req-32e919be-f50e-49d0-8c43-6f3156ee87f3 service nova] Creating event network-vif-deleted:51441d6e-84dd-48a3-bd25-fade9ebd6634 for instance 368bac0a-39c9-4f1e-99f9-84223e7de06b on hv-cinder-85528 Aug 31 01:27:31.880660 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [req-3ad56061-9fa3-40f7-860e-8d60914a393d req-32e919be-f50e-49d0-8c43-6f3156ee87f3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036538 Aug 31 01:27:31.881888 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 302/597] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:27:32.204832 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-86ec2e20-4541-416c-823c-15f670cdd03f tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:32.205508 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-86ec2e20-4541-416c-823c-15f670cdd03f tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:32.214601 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-86ec2e20-4541-416c-823c-15f670cdd03f tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:32.221258 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-86ec2e20-4541-416c-823c-15f670cdd03f tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:32.221258 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-86ec2e20-4541-416c-823c-15f670cdd03f tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:32.221258 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-86ec2e20-4541-416c-823c-15f670cdd03f tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:32.221258 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-86ec2e20-4541-416c-823c-15f670cdd03f tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:32.221569 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-86ec2e20-4541-416c-823c-15f670cdd03f tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:32.279460 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-86ec2e20-4541-416c-823c-15f670cdd03f tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:32.280239 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-86ec2e20-4541-416c-823c-15f670cdd03f tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:32.280876 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-86ec2e20-4541-416c-823c-15f670cdd03f tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:32.281468 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.objects.instance [None req-86ec2e20-4541-416c-823c-15f670cdd03f tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lazy-loading 'fault' on Instance uuid 368bac0a-39c9-4f1e-99f9-84223e7de06b {{(pid=121025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:27:32.328987 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-86ec2e20-4541-416c-823c-15f670cdd03f tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:32.338916 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-86ec2e20-4541-416c-823c-15f670cdd03f tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 200 len: 1328 microversion: 2.1 time: 0.139512 Aug 31 01:27:32.339499 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 296/598] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:32 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 1328 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:27:32.693756 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-23d8d4e4-749e-4ee0-8c75-00981a91ffaf tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:32.694461 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-23d8d4e4-749e-4ee0-8c75-00981a91ffaf tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:32.700663 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-23d8d4e4-749e-4ee0-8c75-00981a91ffaf tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:32.701178 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-23d8d4e4-749e-4ee0-8c75-00981a91ffaf tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:32.701615 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-23d8d4e4-749e-4ee0-8c75-00981a91ffaf tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:32.702305 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-23d8d4e4-749e-4ee0-8c75-00981a91ffaf tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:32.702757 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-23d8d4e4-749e-4ee0-8c75-00981a91ffaf tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:32.703180 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-23d8d4e4-749e-4ee0-8c75-00981a91ffaf tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:32.775180 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-23d8d4e4-749e-4ee0-8c75-00981a91ffaf tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:32.785211 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-23d8d4e4-749e-4ee0-8c75-00981a91ffaf tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac" status: 200 len: 1244 microversion: 2.1 time: 0.096757 Aug 31 01:27:32.786672 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 303/599] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:32 2022] GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac => generated 1244 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:27:33.363135 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-de629233-58a9-4ec9-b958-349988e3a87c tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:33.363671 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-de629233-58a9-4ec9-b958-349988e3a87c tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:33.371099 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-de629233-58a9-4ec9-b958-349988e3a87c tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:33.371581 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-de629233-58a9-4ec9-b958-349988e3a87c tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:33.372015 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-de629233-58a9-4ec9-b958-349988e3a87c tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:33.372822 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-de629233-58a9-4ec9-b958-349988e3a87c tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:33.375574 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-de629233-58a9-4ec9-b958-349988e3a87c tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:33.375574 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-de629233-58a9-4ec9-b958-349988e3a87c tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:33.387744 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.wsgi [None req-de629233-58a9-4ec9-b958-349988e3a87c tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] HTTP exception thrown: Instance 368bac0a-39c9-4f1e-99f9-84223e7de06b could not be found. Aug 31 01:27:33.389421 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-de629233-58a9-4ec9-b958-349988e3a87c tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Request method failure captured: Aug 31 01:27:33.389421 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: request: GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b HTTP/1.1 Aug 31 01:27:33.389421 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept: application/json Aug 31 01:27:33.389421 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept-Encoding: identity Aug 31 01:27:33.389421 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Connection: close Aug 31 01:27:33.389421 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Length: 0 Aug 31 01:27:33.389421 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Type: application/json Aug 31 01:27:33.389421 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Host: 10.222.0.20 Aug 31 01:27:33.389421 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Openstack-System-Scope: None Aug 31 01:27:33.389421 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: User-Agent: python-urllib3/1.26.12 Aug 31 01:27:33.389421 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Auth-Token: gAAAAABjDrgiFX4hHT0f6yuur92UlJsOMqhv6TNqjWHj9hPIbbaojfmVhHBbslHgSlKYO1wW11SLzR79NCVD5awXtoB9TMVCM_YcM7Jz_GEMFPhHmoW_8vlLFpqIyulHHwjhgM0jsADuUZIAE7_N8U1KHD9TlRVR4EyuRKYDUFSC7891geHlU6g Aug 31 01:27:33.389421 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Id: None Aug 31 01:27:33.389421 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Name: None Aug 31 01:27:33.389421 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Identity-Status: Confirmed Aug 31 01:27:33.389421 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Is-Admin-Project: True Aug 31 01:27:33.389421 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Id: default Aug 31 01:27:33.389421 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Name: Default Aug 31 01:27:33.389421 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Id: fb863f706c3846db958c9b7fe367c3f5 Aug 31 01:27:33.389421 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Name: tempest-AttachVolumeTestJSON-1893250502 Aug 31 01:27:33.389421 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Role: member,reader Aug 31 01:27:33.389421 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Roles: member,reader Aug 31 01:27:33.390921 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fb863f706c3846db958c9b7fe367c3f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fb863f706c3846db958c9b7fe367c3f5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb863f706c3846db958c9b7fe367c3f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb863f706c3846db958c9b7fe367c3f5"}]}] Aug 31 01:27:33.390921 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant: tempest-AttachVolumeTestJSON-1893250502 Aug 31 01:27:33.390921 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Id: fb863f706c3846db958c9b7fe367c3f5 Aug 31 01:27:33.390921 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1893250502 Aug 31 01:27:33.390921 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User: tempest-AttachVolumeTestJSON-1893250502-project Aug 31 01:27:33.390921 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Id: default Aug 31 01:27:33.390921 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Name: Default Aug 31 01:27:33.390921 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Id: 1cc3db55df284cd39f28fcfefc619fda Aug 31 01:27:33.390921 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Name: tempest-AttachVolumeTestJSON-1893250502-project Aug 31 01:27:33.390921 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: method: > Aug 31 01:27:33.390921 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: exception: Instance 368bac0a-39c9-4f1e-99f9-84223e7de06b could not be found. Aug 31 01:27:33.390921 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: action_args: {'id': '368bac0a-39c9-4f1e-99f9-84223e7de06b'} Aug 31 01:27:33.391815 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:27:33.391815 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:27:33.391815 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:27:33.391815 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:27:33.391815 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:27:33.391815 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:27:33.391815 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:27:33.391815 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:27:33.391815 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:27:33.391815 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:27:33.391815 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 368bac0a-39c9-4f1e-99f9-84223e7de06b could not be found. Aug 31 01:27:33.391815 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:27:33.391815 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:27:33.391815 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:27:33.391815 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:27:33.391815 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:27:33.391815 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:27:33.391815 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:27:33.391815 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:27:33.391815 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:27:33.393171 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:27:33.393171 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:27:33.393171 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:27:33.393171 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:27:33.393171 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:27:33.393171 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:27:33.393171 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:27:33.393171 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 368bac0a-39c9-4f1e-99f9-84223e7de06b could not be found. Aug 31 01:27:33.393171 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:27:33.393171 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:27:33.393171 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:27:33.393171 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:27:33.393171 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:27:33.393171 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:27:33.393171 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:27:33.393171 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:27:33.393171 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 368bac0a-39c9-4f1e-99f9-84223e7de06b could not be found. Aug 31 01:27:33.393171 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:27:33.394781 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-de629233-58a9-4ec9-b958-349988e3a87c tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Returning 404 to user: Instance 368bac0a-39c9-4f1e-99f9-84223e7de06b could not be found. {{(pid=121025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:27:33.394781 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-de629233-58a9-4ec9-b958-349988e3a87c tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 404 len: 111 microversion: 2.1 time: 0.031713 Aug 31 01:27:33.394781 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 297/600] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:33 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:27:33.400107 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-e3ab1caf-38e5-4a28-9d59-b7cac53ffc9e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '.version_select at 0x7f1fe16d6040>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:33.478292 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-e3ab1caf-38e5-4a28-9d59-b7cac53ffc9e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1661791226" status: 202 len: 0 microversion: 2.1 time: 0.081915 Aug 31 01:27:33.480340 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 304/601] 10.222.0.20 () {58 vars in 1221 bytes} [Wed Aug 31 01:27:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1661791226 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 01:27:33.806867 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-5ec500b2-d215-4c87-a90a-7de2647009e9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:33.807465 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-5ec500b2-d215-4c87-a90a-7de2647009e9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:33.813474 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5ec500b2-d215-4c87-a90a-7de2647009e9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:33.813953 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5ec500b2-d215-4c87-a90a-7de2647009e9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:33.814377 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5ec500b2-d215-4c87-a90a-7de2647009e9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:33.815055 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5ec500b2-d215-4c87-a90a-7de2647009e9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:33.815663 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5ec500b2-d215-4c87-a90a-7de2647009e9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:33.816084 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5ec500b2-d215-4c87-a90a-7de2647009e9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:33.835572 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:27:33.882527 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-5ec500b2-d215-4c87-a90a-7de2647009e9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:33.890912 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-5ec500b2-d215-4c87-a90a-7de2647009e9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac" status: 200 len: 1292 microversion: 2.1 time: 0.087994 Aug 31 01:27:33.892536 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 298/602] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:33 2022] GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac => generated 1292 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:27:34.275189 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-6c3f1102-d7a8-4dc3-b310-9b0f7ad040f5 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Action: 'create', calling method: .version_select at 0x7f1fe185c670>, body: {"keypair": {"name": "tempest-keypair-1556386132", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvIxjTExW2mfiEvTrhlNteFMcv7nvqF1LtU5soLbt6ggBstNcB6y74bSohLWaRs8/t51UfIncMJtVAb9J2pdQNAfWUHk+J0n3y9DiHAMhUNHMkvUh0k3BCk14TA/jat2A=="}} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:27:34.290828 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.quota [None req-6c3f1102-d7a8-4dc3-b310-9b0f7ad040f5 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Getting quotas for project fb863f706c3846db958c9b7fe367c3f5. Resources: {'key_pairs'} {{(pid=121026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 01:27:34.294668 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.quota [None req-6c3f1102-d7a8-4dc3-b310-9b0f7ad040f5 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Getting quotas for user 1cc3db55df284cd39f28fcfefc619fda and project fb863f706c3846db958c9b7fe367c3f5. Resources: {'key_pairs'} {{(pid=121026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 01:27:34.398937 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-6c3f1102-d7a8-4dc3-b310-9b0f7ad040f5 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.127117 Aug 31 01:27:34.398937 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 305/603] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Aug 31 01:27:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:27:34.917758 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-894ae2e1-f8a9-4560-8f4e-6793ed8bf381 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:34.918373 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-894ae2e1-f8a9-4560-8f4e-6793ed8bf381 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:34.925733 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-894ae2e1-f8a9-4560-8f4e-6793ed8bf381 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:34.926329 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-894ae2e1-f8a9-4560-8f4e-6793ed8bf381 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:34.926670 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-894ae2e1-f8a9-4560-8f4e-6793ed8bf381 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:34.932457 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-894ae2e1-f8a9-4560-8f4e-6793ed8bf381 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:34.932960 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-894ae2e1-f8a9-4560-8f4e-6793ed8bf381 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:34.934141 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-894ae2e1-f8a9-4560-8f4e-6793ed8bf381 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:35.153933 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-894ae2e1-f8a9-4560-8f4e-6793ed8bf381 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:35.162466 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-894ae2e1-f8a9-4560-8f4e-6793ed8bf381 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac" status: 200 len: 1366 microversion: 2.1 time: 0.248899 Aug 31 01:27:35.163159 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 299/604] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:34 2022] GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:27:36.186949 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-a0206d7f-057a-4ff7-a0cd-bf7f8470ace6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:36.187679 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-a0206d7f-057a-4ff7-a0cd-bf7f8470ace6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:36.194412 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a0206d7f-057a-4ff7-a0cd-bf7f8470ace6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:36.195203 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a0206d7f-057a-4ff7-a0cd-bf7f8470ace6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:36.195714 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a0206d7f-057a-4ff7-a0cd-bf7f8470ace6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:36.196416 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a0206d7f-057a-4ff7-a0cd-bf7f8470ace6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:36.196966 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a0206d7f-057a-4ff7-a0cd-bf7f8470ace6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:36.197309 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a0206d7f-057a-4ff7-a0cd-bf7f8470ace6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:36.250916 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-974097ca-92ef-46af-acce-768cc879848a req-9c851ce2-2b9c-4b1f-aa2b-dc45810bba4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac", "tag": "efe8dede-55a6-41b6-97f0-2979138ce376"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:27:36.261973 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-974097ca-92ef-46af-acce-768cc879848a req-9c851ce2-2b9c-4b1f-aa2b-dc45810bba4b service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:36.262865 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-974097ca-92ef-46af-acce-768cc879848a req-9c851ce2-2b9c-4b1f-aa2b-dc45810bba4b service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:36.263449 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-974097ca-92ef-46af-acce-768cc879848a req-9c851ce2-2b9c-4b1f-aa2b-dc45810bba4b service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:36.281728 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-974097ca-92ef-46af-acce-768cc879848a req-9c851ce2-2b9c-4b1f-aa2b-dc45810bba4b service nova] Creating event network-changed:efe8dede-55a6-41b6-97f0-2979138ce376 for instance 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac on hv-cinder-85528 Aug 31 01:27:36.286717 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-974097ca-92ef-46af-acce-768cc879848a req-9c851ce2-2b9c-4b1f-aa2b-dc45810bba4b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039653 Aug 31 01:27:36.287544 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 300/605] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:27:36.523249 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-a0206d7f-057a-4ff7-a0cd-bf7f8470ace6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:36.531014 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-a0206d7f-057a-4ff7-a0cd-bf7f8470ace6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac" status: 200 len: 1366 microversion: 2.1 time: 0.349405 Aug 31 01:27:36.531689 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 306/606] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:36 2022] GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac => generated 1366 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:27:37.502579 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-1deecc80-1cb7-4467-b9e0-e9a9c6ceae35 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1246168404", "imageRef": "ed6d3236-defa-4ccf-90ba-343c0d0ad58e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2d97e458-c7f0-41e8-8974-7a68b9809489"}], "security_groups": [{"name": "tempest-securitygroup--924789410"}], "key_name": "tempest-keypair-1556386132", "user_data": "}} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:27:37.551712 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-ff5910a8-74d3-4a54-80a0-6f8b5a697302 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:37.552332 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-ff5910a8-74d3-4a54-80a0-6f8b5a697302 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:37.559344 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ff5910a8-74d3-4a54-80a0-6f8b5a697302 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:37.560088 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ff5910a8-74d3-4a54-80a0-6f8b5a697302 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:37.560755 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ff5910a8-74d3-4a54-80a0-6f8b5a697302 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:37.561624 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ff5910a8-74d3-4a54-80a0-6f8b5a697302 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:37.562070 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ff5910a8-74d3-4a54-80a0-6f8b5a697302 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:37.562495 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ff5910a8-74d3-4a54-80a0-6f8b5a697302 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:37.646906 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.network.neutron [None req-1deecc80-1cb7-4467-b9e0-e9a9c6ceae35 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] validate_networks() for [('2d97e458-c7f0-41e8-8974-7a68b9809489', None, None, None, None, None)] {{(pid=121025) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 01:27:37.779678 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-ff5910a8-74d3-4a54-80a0-6f8b5a697302 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:37.787802 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-ff5910a8-74d3-4a54-80a0-6f8b5a697302 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac" status: 200 len: 1366 microversion: 2.1 time: 0.240328 Aug 31 01:27:37.788371 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 307/607] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:37 2022] GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:27:38.276368 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-1deecc80-1cb7-4467-b9e0-e9a9c6ceae35 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Flavor limits 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 01:27:38.276810 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-1deecc80-1cb7-4467-b9e0-e9a9c6ceae35 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Image limits 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 01:27:38.277667 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-1deecc80-1cb7-4467-b9e0-e9a9c6ceae35 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Flavor pref 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 01:27:38.283093 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-1deecc80-1cb7-4467-b9e0-e9a9c6ceae35 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Image pref 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 01:27:38.287217 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-1deecc80-1cb7-4467-b9e0-e9a9c6ceae35 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 01:27:38.296379 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1deecc80-1cb7-4467-b9e0-e9a9c6ceae35 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:38.296912 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1deecc80-1cb7-4467-b9e0-e9a9c6ceae35 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:38.297512 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1deecc80-1cb7-4467-b9e0-e9a9c6ceae35 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:38.298388 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1deecc80-1cb7-4467-b9e0-e9a9c6ceae35 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:38.299017 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1deecc80-1cb7-4467-b9e0-e9a9c6ceae35 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:38.299443 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1deecc80-1cb7-4467-b9e0-e9a9c6ceae35 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:38.318092 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.quota [None req-1deecc80-1cb7-4467-b9e0-e9a9c6ceae35 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Getting quotas for project fb863f706c3846db958c9b7fe367c3f5. Resources: {'instances', 'cores', 'ram'} {{(pid=121025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 01:27:38.322084 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.quota [None req-1deecc80-1cb7-4467-b9e0-e9a9c6ceae35 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Getting quotas for user 1cc3db55df284cd39f28fcfefc619fda and project fb863f706c3846db958c9b7fe367c3f5. Resources: {'instances', 'cores', 'ram'} {{(pid=121025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 01:27:38.323613 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:27:38.334906 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-1deecc80-1cb7-4467-b9e0-e9a9c6ceae35 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Going to run 1 instances... {{(pid=121025) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 01:27:38.337325 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-1deecc80-1cb7-4467-b9e0-e9a9c6ceae35 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: f29a15ea-aad6-4491-a2e4-602f9ee66899] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ed6d3236-defa-4ccf-90ba-343c0d0ad58e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 01:27:38.428693 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-1deecc80-1cb7-4467-b9e0-e9a9c6ceae35 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.931320 Aug 31 01:27:38.429770 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 301/608] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 31 01:27:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 01:27:38.441240 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-eba5f56d-de9c-4702-bf50-7e59ef788d28 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:38.442004 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-eba5f56d-de9c-4702-bf50-7e59ef788d28 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: f29a15ea-aad6-4491-a2e4-602f9ee66899] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:38.518079 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-eba5f56d-de9c-4702-bf50-7e59ef788d28 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:38.525347 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-eba5f56d-de9c-4702-bf50-7e59ef788d28 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899" status: 200 len: 1238 microversion: 2.1 time: 0.088542 Aug 31 01:27:38.526857 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 308/609] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:38 2022] GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899 => generated 1238 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:27:38.984597 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-278dcf5c-8182-4dc7-b806-bf4e160106c9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:38.986290 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-278dcf5c-8182-4dc7-b806-bf4e160106c9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:38.992432 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-278dcf5c-8182-4dc7-b806-bf4e160106c9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:38.992949 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-278dcf5c-8182-4dc7-b806-bf4e160106c9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:38.993415 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-278dcf5c-8182-4dc7-b806-bf4e160106c9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:38.994108 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-278dcf5c-8182-4dc7-b806-bf4e160106c9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:38.994559 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-278dcf5c-8182-4dc7-b806-bf4e160106c9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:38.995016 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-278dcf5c-8182-4dc7-b806-bf4e160106c9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:39.128984 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-278dcf5c-8182-4dc7-b806-bf4e160106c9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:39.137507 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-278dcf5c-8182-4dc7-b806-bf4e160106c9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac" status: 200 len: 1366 microversion: 2.1 time: 0.333820 Aug 31 01:27:39.138340 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 302/610] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:38 2022] GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac => generated 1366 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:27:39.548320 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-1bbfc6b9-83d7-4da8-83df-dd59b4759b6f tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:39.548952 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-1bbfc6b9-83d7-4da8-83df-dd59b4759b6f tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: f29a15ea-aad6-4491-a2e4-602f9ee66899] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:39.556004 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1bbfc6b9-83d7-4da8-83df-dd59b4759b6f tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:39.556475 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1bbfc6b9-83d7-4da8-83df-dd59b4759b6f tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:39.556936 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1bbfc6b9-83d7-4da8-83df-dd59b4759b6f tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:39.557612 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1bbfc6b9-83d7-4da8-83df-dd59b4759b6f tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:39.558056 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1bbfc6b9-83d7-4da8-83df-dd59b4759b6f tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:39.558466 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1bbfc6b9-83d7-4da8-83df-dd59b4759b6f tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:39.620309 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-1bbfc6b9-83d7-4da8-83df-dd59b4759b6f tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:39.627773 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-1bbfc6b9-83d7-4da8-83df-dd59b4759b6f tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899" status: 200 len: 1242 microversion: 2.1 time: 0.083369 Aug 31 01:27:39.628334 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 309/611] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:39 2022] GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899 => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:27:40.160292 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-75dff176-41ef-416f-8e09-9341f2519e55 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:40.161603 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-75dff176-41ef-416f-8e09-9341f2519e55 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:40.170251 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-75dff176-41ef-416f-8e09-9341f2519e55 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:40.170251 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-75dff176-41ef-416f-8e09-9341f2519e55 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:40.170251 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-75dff176-41ef-416f-8e09-9341f2519e55 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:40.172823 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-75dff176-41ef-416f-8e09-9341f2519e55 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:40.173302 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-75dff176-41ef-416f-8e09-9341f2519e55 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:40.173737 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-75dff176-41ef-416f-8e09-9341f2519e55 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:40.320804 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-75dff176-41ef-416f-8e09-9341f2519e55 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:40.328990 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-75dff176-41ef-416f-8e09-9341f2519e55 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac" status: 200 len: 1366 microversion: 2.1 time: 0.173377 Aug 31 01:27:40.329824 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 303/612] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:40 2022] GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:27:40.649155 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-e70151c1-ea31-4cde-9f3b-92fc654045dc tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:40.649814 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-e70151c1-ea31-4cde-9f3b-92fc654045dc tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: f29a15ea-aad6-4491-a2e4-602f9ee66899] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:40.653078 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:27:40.656576 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e70151c1-ea31-4cde-9f3b-92fc654045dc tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:40.657100 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e70151c1-ea31-4cde-9f3b-92fc654045dc tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:40.660928 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e70151c1-ea31-4cde-9f3b-92fc654045dc tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:40.660928 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e70151c1-ea31-4cde-9f3b-92fc654045dc tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:40.660928 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e70151c1-ea31-4cde-9f3b-92fc654045dc tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:40.660928 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e70151c1-ea31-4cde-9f3b-92fc654045dc tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:40.726304 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-e70151c1-ea31-4cde-9f3b-92fc654045dc tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:40.734439 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-e70151c1-ea31-4cde-9f3b-92fc654045dc tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899" status: 200 len: 1290 microversion: 2.1 time: 0.089949 Aug 31 01:27:40.735831 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 310/613] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:40 2022] GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899 => generated 1290 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:27:40.857979 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-84cc6456-5b0a-460b-ac41-e698a9f0d779 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:40.858725 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-84cc6456-5b0a-460b-ac41-e698a9f0d779 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:40.865990 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-84cc6456-5b0a-460b-ac41-e698a9f0d779 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:40.866725 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-84cc6456-5b0a-460b-ac41-e698a9f0d779 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:40.867381 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-84cc6456-5b0a-460b-ac41-e698a9f0d779 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:40.868325 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-84cc6456-5b0a-460b-ac41-e698a9f0d779 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:40.869040 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-84cc6456-5b0a-460b-ac41-e698a9f0d779 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:40.869680 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-84cc6456-5b0a-460b-ac41-e698a9f0d779 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:40.904093 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-84cc6456-5b0a-460b-ac41-e698a9f0d779 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09/ips" status: 200 len: 152 microversion: 2.20 time: 0.236386 Aug 31 01:27:40.907877 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 304/614] 10.222.0.20 () {60 vars in 1289 bytes} [Wed Aug 31 01:27:40 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09/ips => generated 152 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 01:27:41.352465 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-09207af6-8554-4c21-9b75-4aa5517b798b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:41.353560 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-09207af6-8554-4c21-9b75-4aa5517b798b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:41.360594 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-09207af6-8554-4c21-9b75-4aa5517b798b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:41.361242 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-09207af6-8554-4c21-9b75-4aa5517b798b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:41.361752 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-09207af6-8554-4c21-9b75-4aa5517b798b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:41.362533 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-09207af6-8554-4c21-9b75-4aa5517b798b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:41.363081 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-09207af6-8554-4c21-9b75-4aa5517b798b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:41.363649 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-09207af6-8554-4c21-9b75-4aa5517b798b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:41.427258 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell0:SELECT=2 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:27:41.641913 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-09207af6-8554-4c21-9b75-4aa5517b798b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:41.651327 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-09207af6-8554-4c21-9b75-4aa5517b798b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac" status: 200 len: 1366 microversion: 2.1 time: 0.303688 Aug 31 01:27:41.656866 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 311/615] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:41 2022] GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac => generated 1366 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:27:41.756150 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-157648b9-397e-4542-b02d-9064026938fa tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:41.757440 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-157648b9-397e-4542-b02d-9064026938fa tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: f29a15ea-aad6-4491-a2e4-602f9ee66899] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:41.765117 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-157648b9-397e-4542-b02d-9064026938fa tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:41.766071 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-157648b9-397e-4542-b02d-9064026938fa tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:41.767111 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-157648b9-397e-4542-b02d-9064026938fa tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:41.768208 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-157648b9-397e-4542-b02d-9064026938fa tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:41.769544 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-157648b9-397e-4542-b02d-9064026938fa tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:41.774307 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-157648b9-397e-4542-b02d-9064026938fa tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:41.889435 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-157648b9-397e-4542-b02d-9064026938fa tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:41.935632 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-157648b9-397e-4542-b02d-9064026938fa tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899" status: 200 len: 1296 microversion: 2.1 time: 0.183346 Aug 31 01:27:41.936224 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 305/616] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:41 2022] GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899 => generated 1296 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:27:42.451870 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [req-f564ae96-b7c9-42d8-a0e6-0fe19dcf2a4c req-557f1821-13a0-4fcf-80af-a6c727b1eb17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac", "name": "network-vif-plugged", "status": "completed", "tag": "efe8dede-55a6-41b6-97f0-2979138ce376"}]} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:27:42.463554 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-f564ae96-b7c9-42d8-a0e6-0fe19dcf2a4c req-557f1821-13a0-4fcf-80af-a6c727b1eb17 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:42.464051 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-f564ae96-b7c9-42d8-a0e6-0fe19dcf2a4c req-557f1821-13a0-4fcf-80af-a6c727b1eb17 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:42.464683 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-f564ae96-b7c9-42d8-a0e6-0fe19dcf2a4c req-557f1821-13a0-4fcf-80af-a6c727b1eb17 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:42.477621 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.compute.server_external_events [req-f564ae96-b7c9-42d8-a0e6-0fe19dcf2a4c req-557f1821-13a0-4fcf-80af-a6c727b1eb17 service nova] Creating event network-vif-plugged:efe8dede-55a6-41b6-97f0-2979138ce376 for instance 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac on hv-cinder-85528 Aug 31 01:27:42.482390 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [req-f564ae96-b7c9-42d8-a0e6-0fe19dcf2a4c req-557f1821-13a0-4fcf-80af-a6c727b1eb17 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035695 Aug 31 01:27:42.487236 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 312/617] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:27:42.673378 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-fba249b6-37d6-4547-8479-ce47b78cedbe tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:42.676886 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-fba249b6-37d6-4547-8479-ce47b78cedbe tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:42.680231 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fba249b6-37d6-4547-8479-ce47b78cedbe tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:42.680731 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fba249b6-37d6-4547-8479-ce47b78cedbe tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:42.681186 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fba249b6-37d6-4547-8479-ce47b78cedbe tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:42.681890 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fba249b6-37d6-4547-8479-ce47b78cedbe tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:42.682324 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fba249b6-37d6-4547-8479-ce47b78cedbe tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:42.682744 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fba249b6-37d6-4547-8479-ce47b78cedbe tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:42.853489 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-fba249b6-37d6-4547-8479-ce47b78cedbe tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:42.864281 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-fba249b6-37d6-4547-8479-ce47b78cedbe tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac" status: 200 len: 1366 microversion: 2.1 time: 0.194742 Aug 31 01:27:42.865206 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 306/618] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:42 2022] GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:27:42.959427 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-8a9ba497-3d74-47ab-b960-a661ea239aed tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:42.960495 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-8a9ba497-3d74-47ab-b960-a661ea239aed tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: f29a15ea-aad6-4491-a2e4-602f9ee66899] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:42.967214 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8a9ba497-3d74-47ab-b960-a661ea239aed tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:42.967770 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8a9ba497-3d74-47ab-b960-a661ea239aed tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:42.968444 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8a9ba497-3d74-47ab-b960-a661ea239aed tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:42.969600 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8a9ba497-3d74-47ab-b960-a661ea239aed tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:42.970350 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8a9ba497-3d74-47ab-b960-a661ea239aed tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:42.970779 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8a9ba497-3d74-47ab-b960-a661ea239aed tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:43.162389 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-8a9ba497-3d74-47ab-b960-a661ea239aed tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:43.168975 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-0590c448-f083-47c1-9f8a-faaac08ffaa6 req-ca2fe8c2-756d-477a-94fe-e9a95425c792 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f29a15ea-aad6-4491-a2e4-602f9ee66899", "tag": "cdfb0f64-8b81-4f78-aca5-823b4f781b7b"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:27:43.170839 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-8a9ba497-3d74-47ab-b960-a661ea239aed tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899" status: 200 len: 1363 microversion: 2.1 time: 0.217361 Aug 31 01:27:43.172775 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 313/619] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:42 2022] GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899 => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:27:43.184786 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-0590c448-f083-47c1-9f8a-faaac08ffaa6 req-ca2fe8c2-756d-477a-94fe-e9a95425c792 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:43.185354 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-0590c448-f083-47c1-9f8a-faaac08ffaa6 req-ca2fe8c2-756d-477a-94fe-e9a95425c792 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:43.185820 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-0590c448-f083-47c1-9f8a-faaac08ffaa6 req-ca2fe8c2-756d-477a-94fe-e9a95425c792 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:43.202372 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-0590c448-f083-47c1-9f8a-faaac08ffaa6 req-ca2fe8c2-756d-477a-94fe-e9a95425c792 service nova] Creating event network-changed:cdfb0f64-8b81-4f78-aca5-823b4f781b7b for instance f29a15ea-aad6-4491-a2e4-602f9ee66899 on hv-cinder-85528 Aug 31 01:27:43.203535 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-90dc00ca-0bdf-4284-b357-5300ad11a795 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:27:43.204511 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-90dc00ca-0bdf-4284-b357-5300ad11a795 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:43.208235 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-0590c448-f083-47c1-9f8a-faaac08ffaa6 req-ca2fe8c2-756d-477a-94fe-e9a95425c792 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043474 Aug 31 01:27:43.209229 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 307/620] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:27:43.210439 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-90dc00ca-0bdf-4284-b357-5300ad11a795 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:43.210919 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-90dc00ca-0bdf-4284-b357-5300ad11a795 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:43.211348 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-90dc00ca-0bdf-4284-b357-5300ad11a795 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:43.212131 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-90dc00ca-0bdf-4284-b357-5300ad11a795 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:43.212582 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-90dc00ca-0bdf-4284-b357-5300ad11a795 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:43.213158 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-90dc00ca-0bdf-4284-b357-5300ad11a795 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:43.239006 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.objects.instance [None req-90dc00ca-0bdf-4284-b357-5300ad11a795 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lazy-loading 'flavor' on Instance uuid b7311a59-7d10-4edb-be41-f6872e563e09 {{(pid=121026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:27:43.837859 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-90dc00ca-0bdf-4284-b357-5300ad11a795 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "POST /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09/action" status: 202 len: 0 microversion: 2.20 time: 0.638169 Aug 31 01:27:43.838882 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 314/621] 10.222.0.20 () {62 vars in 1319 bytes} [Wed Aug 31 01:27:43 2022] POST /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09/action => generated 0 bytes in 640 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 31 01:27:43.853595 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-c266d3bb-8936-45fa-9d17-47b372bf1360 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:43.858666 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-c266d3bb-8936-45fa-9d17-47b372bf1360 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:43.865731 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c266d3bb-8936-45fa-9d17-47b372bf1360 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:43.866345 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c266d3bb-8936-45fa-9d17-47b372bf1360 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:43.866791 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c266d3bb-8936-45fa-9d17-47b372bf1360 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:43.867682 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c266d3bb-8936-45fa-9d17-47b372bf1360 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:43.868134 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c266d3bb-8936-45fa-9d17-47b372bf1360 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:43.868551 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c266d3bb-8936-45fa-9d17-47b372bf1360 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:43.895764 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-fc7b088c-db63-442f-82e0-f474e490c9ea tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:43.896588 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-fc7b088c-db63-442f-82e0-f474e490c9ea tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:43.914773 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fc7b088c-db63-442f-82e0-f474e490c9ea tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:43.915266 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fc7b088c-db63-442f-82e0-f474e490c9ea tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:43.915723 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fc7b088c-db63-442f-82e0-f474e490c9ea tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:43.920992 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fc7b088c-db63-442f-82e0-f474e490c9ea tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:43.921360 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fc7b088c-db63-442f-82e0-f474e490c9ea tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:43.921795 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fc7b088c-db63-442f-82e0-f474e490c9ea tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:44.065848 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-c266d3bb-8936-45fa-9d17-47b372bf1360 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:44.065848 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-c266d3bb-8936-45fa-9d17-47b372bf1360 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:44.066449 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-c266d3bb-8936-45fa-9d17-47b372bf1360 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:44.068345 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-c266d3bb-8936-45fa-9d17-47b372bf1360 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1722 microversion: 2.20 time: 0.225252 Aug 31 01:27:44.069078 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 308/622] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:27:43 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:27:44.094072 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-fc7b088c-db63-442f-82e0-f474e490c9ea tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:44.100125 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-fc7b088c-db63-442f-82e0-f474e490c9ea tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac" status: 200 len: 1366 microversion: 2.1 time: 0.210232 Aug 31 01:27:44.100693 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 315/623] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:43 2022] GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:27:44.192800 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-7b0bc0cc-a82e-4ce0-a556-1ce761221b85 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:44.193413 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-7b0bc0cc-a82e-4ce0-a556-1ce761221b85 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: f29a15ea-aad6-4491-a2e4-602f9ee66899] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:44.199297 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7b0bc0cc-a82e-4ce0-a556-1ce761221b85 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:44.199779 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7b0bc0cc-a82e-4ce0-a556-1ce761221b85 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:44.200252 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7b0bc0cc-a82e-4ce0-a556-1ce761221b85 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:44.200971 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7b0bc0cc-a82e-4ce0-a556-1ce761221b85 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:44.201428 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7b0bc0cc-a82e-4ce0-a556-1ce761221b85 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:44.201851 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7b0bc0cc-a82e-4ce0-a556-1ce761221b85 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:44.360292 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-7b0bc0cc-a82e-4ce0-a556-1ce761221b85 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:44.367392 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-7b0bc0cc-a82e-4ce0-a556-1ce761221b85 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899" status: 200 len: 1363 microversion: 2.1 time: 0.178480 Aug 31 01:27:44.367953 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 309/624] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:44 2022] GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:27:45.091919 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-347478ca-2fd1-43cf-bb23-b3fcaefdd956 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:45.092533 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-347478ca-2fd1-43cf-bb23-b3fcaefdd956 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:45.099781 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-347478ca-2fd1-43cf-bb23-b3fcaefdd956 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:45.100330 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-347478ca-2fd1-43cf-bb23-b3fcaefdd956 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:45.100582 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-347478ca-2fd1-43cf-bb23-b3fcaefdd956 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:45.101298 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-347478ca-2fd1-43cf-bb23-b3fcaefdd956 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:45.101747 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-347478ca-2fd1-43cf-bb23-b3fcaefdd956 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:45.102184 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-347478ca-2fd1-43cf-bb23-b3fcaefdd956 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:45.106529 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:27:45.122054 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-50893aab-2338-40f1-bb51-f32f8ddc2173 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:45.123303 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-50893aab-2338-40f1-bb51-f32f8ddc2173 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:45.130504 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-50893aab-2338-40f1-bb51-f32f8ddc2173 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:45.130997 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-50893aab-2338-40f1-bb51-f32f8ddc2173 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:45.131475 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-50893aab-2338-40f1-bb51-f32f8ddc2173 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:45.132194 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-50893aab-2338-40f1-bb51-f32f8ddc2173 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:45.132651 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-50893aab-2338-40f1-bb51-f32f8ddc2173 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:45.133180 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-50893aab-2338-40f1-bb51-f32f8ddc2173 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:45.284170 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-347478ca-2fd1-43cf-bb23-b3fcaefdd956 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:45.292991 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-347478ca-2fd1-43cf-bb23-b3fcaefdd956 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:45.294435 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-347478ca-2fd1-43cf-bb23-b3fcaefdd956 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:45.295603 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-347478ca-2fd1-43cf-bb23-b3fcaefdd956 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1722 microversion: 2.20 time: 0.207640 Aug 31 01:27:45.312593 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 316/625] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:27:45 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:27:45.312820 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-50893aab-2338-40f1-bb51-f32f8ddc2173 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:45.320740 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-50893aab-2338-40f1-bb51-f32f8ddc2173 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac" status: 200 len: 1555 microversion: 2.1 time: 0.202874 Aug 31 01:27:45.321321 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 310/626] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:45 2022] GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac => generated 1555 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:27:45.342194 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-00bee7b2-4b26-4bdb-a20b-b3385ef6908b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:45.342795 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-00bee7b2-4b26-4bdb-a20b-b3385ef6908b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:45.349297 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-00bee7b2-4b26-4bdb-a20b-b3385ef6908b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:45.349786 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-00bee7b2-4b26-4bdb-a20b-b3385ef6908b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:45.350399 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-00bee7b2-4b26-4bdb-a20b-b3385ef6908b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:45.350911 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-00bee7b2-4b26-4bdb-a20b-b3385ef6908b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:45.351365 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-00bee7b2-4b26-4bdb-a20b-b3385ef6908b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:45.351787 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-00bee7b2-4b26-4bdb-a20b-b3385ef6908b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:45.388301 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-fc0d732f-efd0-49f4-b488-1caa54a79a19 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:45.388849 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-fc0d732f-efd0-49f4-b488-1caa54a79a19 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: f29a15ea-aad6-4491-a2e4-602f9ee66899] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:45.395674 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fc0d732f-efd0-49f4-b488-1caa54a79a19 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:45.396132 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fc0d732f-efd0-49f4-b488-1caa54a79a19 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:45.396551 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fc0d732f-efd0-49f4-b488-1caa54a79a19 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:45.397445 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fc0d732f-efd0-49f4-b488-1caa54a79a19 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:45.398046 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fc0d732f-efd0-49f4-b488-1caa54a79a19 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:45.398615 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fc0d732f-efd0-49f4-b488-1caa54a79a19 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:45.497194 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-00bee7b2-4b26-4bdb-a20b-b3385ef6908b tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.159315 Aug 31 01:27:45.498207 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 317/627] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Aug 31 01:27:45 2022] GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac/os-interface => generated 284 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:27:45.578559 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-fc0d732f-efd0-49f4-b488-1caa54a79a19 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:45.588793 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-fc0d732f-efd0-49f4-b488-1caa54a79a19 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899" status: 200 len: 1363 microversion: 2.1 time: 0.204029 Aug 31 01:27:45.589409 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 311/628] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:45 2022] GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899 => generated 1363 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:27:46.319871 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-46eb90f4-5a45-4bb9-916b-1f043e9d445f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:46.320678 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-46eb90f4-5a45-4bb9-916b-1f043e9d445f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:46.328888 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-46eb90f4-5a45-4bb9-916b-1f043e9d445f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:46.328888 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-46eb90f4-5a45-4bb9-916b-1f043e9d445f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:46.328888 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-46eb90f4-5a45-4bb9-916b-1f043e9d445f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:46.328888 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-46eb90f4-5a45-4bb9-916b-1f043e9d445f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:46.329883 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-46eb90f4-5a45-4bb9-916b-1f043e9d445f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:46.330522 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-46eb90f4-5a45-4bb9-916b-1f043e9d445f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:46.467456 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-46eb90f4-5a45-4bb9-916b-1f043e9d445f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:46.476889 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-46eb90f4-5a45-4bb9-916b-1f043e9d445f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:46.479784 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-46eb90f4-5a45-4bb9-916b-1f043e9d445f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:46.481113 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-46eb90f4-5a45-4bb9-916b-1f043e9d445f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1722 microversion: 2.20 time: 0.166099 Aug 31 01:27:46.493354 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 318/629] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:27:46 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:27:46.611718 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-70b6b911-b59d-448a-ad43-be07d4207b14 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:46.612940 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-70b6b911-b59d-448a-ad43-be07d4207b14 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: f29a15ea-aad6-4491-a2e4-602f9ee66899] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:46.615783 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [req-e88c653b-1fef-4242-b0b5-de0e0a8f8baf req-a02c7802-e16e-424a-9f0c-dc0e48281de8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac", "tag": "efe8dede-55a6-41b6-97f0-2979138ce376"}]} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:27:46.622053 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-70b6b911-b59d-448a-ad43-be07d4207b14 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:46.622822 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-70b6b911-b59d-448a-ad43-be07d4207b14 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:46.623451 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-70b6b911-b59d-448a-ad43-be07d4207b14 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:46.625036 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-70b6b911-b59d-448a-ad43-be07d4207b14 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:46.625358 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-e88c653b-1fef-4242-b0b5-de0e0a8f8baf req-a02c7802-e16e-424a-9f0c-dc0e48281de8 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:46.625834 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-e88c653b-1fef-4242-b0b5-de0e0a8f8baf req-a02c7802-e16e-424a-9f0c-dc0e48281de8 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:46.626266 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-e88c653b-1fef-4242-b0b5-de0e0a8f8baf req-a02c7802-e16e-424a-9f0c-dc0e48281de8 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:46.626595 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-70b6b911-b59d-448a-ad43-be07d4207b14 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:46.627381 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-70b6b911-b59d-448a-ad43-be07d4207b14 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:46.640153 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.compute.server_external_events [req-e88c653b-1fef-4242-b0b5-de0e0a8f8baf req-a02c7802-e16e-424a-9f0c-dc0e48281de8 service nova] Creating event network-changed:efe8dede-55a6-41b6-97f0-2979138ce376 for instance 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac on hv-cinder-85528 Aug 31 01:27:46.644631 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [req-e88c653b-1fef-4242-b0b5-de0e0a8f8baf req-a02c7802-e16e-424a-9f0c-dc0e48281de8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033108 Aug 31 01:27:46.648866 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 319/630] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:27:46.814520 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-70b6b911-b59d-448a-ad43-be07d4207b14 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:46.824045 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-70b6b911-b59d-448a-ad43-be07d4207b14 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899" status: 200 len: 1363 microversion: 2.1 time: 0.217836 Aug 31 01:27:46.835276 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 312/631] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:46 2022] GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899 => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:27:47.508185 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-0a3b2c91-b428-4c35-95f3-b4ab7856b7b9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:47.508988 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-0a3b2c91-b428-4c35-95f3-b4ab7856b7b9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:47.515389 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0a3b2c91-b428-4c35-95f3-b4ab7856b7b9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:47.517313 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0a3b2c91-b428-4c35-95f3-b4ab7856b7b9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:47.517746 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0a3b2c91-b428-4c35-95f3-b4ab7856b7b9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:47.518533 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0a3b2c91-b428-4c35-95f3-b4ab7856b7b9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:47.519057 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0a3b2c91-b428-4c35-95f3-b4ab7856b7b9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:47.519549 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0a3b2c91-b428-4c35-95f3-b4ab7856b7b9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:47.685930 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-0a3b2c91-b428-4c35-95f3-b4ab7856b7b9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:47.695058 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-0a3b2c91-b428-4c35-95f3-b4ab7856b7b9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:47.696542 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-0a3b2c91-b428-4c35-95f3-b4ab7856b7b9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:47.697749 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-0a3b2c91-b428-4c35-95f3-b4ab7856b7b9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1722 microversion: 2.20 time: 0.194935 Aug 31 01:27:47.698324 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 320/632] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:27:47 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:27:47.847042 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-294c4bc7-48d8-4e90-8efc-cf5cfd75a4a5 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:47.847654 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-294c4bc7-48d8-4e90-8efc-cf5cfd75a4a5 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: f29a15ea-aad6-4491-a2e4-602f9ee66899] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:47.854013 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-294c4bc7-48d8-4e90-8efc-cf5cfd75a4a5 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:47.854706 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-294c4bc7-48d8-4e90-8efc-cf5cfd75a4a5 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:47.855129 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-294c4bc7-48d8-4e90-8efc-cf5cfd75a4a5 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:47.855987 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-294c4bc7-48d8-4e90-8efc-cf5cfd75a4a5 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:47.856508 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-294c4bc7-48d8-4e90-8efc-cf5cfd75a4a5 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:47.856869 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-294c4bc7-48d8-4e90-8efc-cf5cfd75a4a5 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:47.992002 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-294c4bc7-48d8-4e90-8efc-cf5cfd75a4a5 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:48.001622 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-294c4bc7-48d8-4e90-8efc-cf5cfd75a4a5 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899" status: 200 len: 1363 microversion: 2.1 time: 0.158346 Aug 31 01:27:48.012553 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 313/633] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:47 2022] GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:27:48.406782 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [req-b3e91924-5bda-4ba3-9dc8-2b6a24759390 req-ee69e6dd-a19e-49c0-85ab-bce40b0bc322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f29a15ea-aad6-4491-a2e4-602f9ee66899", "name": "network-vif-plugged", "status": "completed", "tag": "cdfb0f64-8b81-4f78-aca5-823b4f781b7b"}]} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:27:48.417283 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-b3e91924-5bda-4ba3-9dc8-2b6a24759390 req-ee69e6dd-a19e-49c0-85ab-bce40b0bc322 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:48.417889 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-b3e91924-5bda-4ba3-9dc8-2b6a24759390 req-ee69e6dd-a19e-49c0-85ab-bce40b0bc322 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:48.418669 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-b3e91924-5bda-4ba3-9dc8-2b6a24759390 req-ee69e6dd-a19e-49c0-85ab-bce40b0bc322 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:48.432352 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.compute.server_external_events [req-b3e91924-5bda-4ba3-9dc8-2b6a24759390 req-ee69e6dd-a19e-49c0-85ab-bce40b0bc322 service nova] Creating event network-vif-plugged:cdfb0f64-8b81-4f78-aca5-823b4f781b7b for instance f29a15ea-aad6-4491-a2e4-602f9ee66899 on hv-cinder-85528 Aug 31 01:27:48.437493 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [req-b3e91924-5bda-4ba3-9dc8-2b6a24759390 req-ee69e6dd-a19e-49c0-85ab-bce40b0bc322 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034825 Aug 31 01:27:48.438440 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 321/634] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:27:48.721142 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-90242a2a-8583-4b33-843e-7cf328255a72 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:48.721742 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-90242a2a-8583-4b33-843e-7cf328255a72 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:48.724318 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell0:SELECT=2 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:27:48.724995 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell0:SELECT=12 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:27:48.730888 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-90242a2a-8583-4b33-843e-7cf328255a72 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:48.731413 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-90242a2a-8583-4b33-843e-7cf328255a72 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:48.731853 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-90242a2a-8583-4b33-843e-7cf328255a72 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:48.732653 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-90242a2a-8583-4b33-843e-7cf328255a72 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:48.733138 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-90242a2a-8583-4b33-843e-7cf328255a72 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:48.737889 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-90242a2a-8583-4b33-843e-7cf328255a72 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:48.884276 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-90242a2a-8583-4b33-843e-7cf328255a72 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:48.894209 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-90242a2a-8583-4b33-843e-7cf328255a72 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:48.896359 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-90242a2a-8583-4b33-843e-7cf328255a72 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:48.897639 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-90242a2a-8583-4b33-843e-7cf328255a72 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1722 microversion: 2.20 time: 0.180394 Aug 31 01:27:48.898718 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 314/635] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:27:48 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:27:49.024445 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-6c908975-64df-4a74-81a8-d3e6f9d2d3f9 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:49.025257 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-6c908975-64df-4a74-81a8-d3e6f9d2d3f9 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: f29a15ea-aad6-4491-a2e4-602f9ee66899] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:49.027643 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell0:SELECT=12 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:27:49.032978 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6c908975-64df-4a74-81a8-d3e6f9d2d3f9 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:49.033468 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6c908975-64df-4a74-81a8-d3e6f9d2d3f9 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:49.033903 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6c908975-64df-4a74-81a8-d3e6f9d2d3f9 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:49.034601 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6c908975-64df-4a74-81a8-d3e6f9d2d3f9 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:49.035937 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6c908975-64df-4a74-81a8-d3e6f9d2d3f9 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:49.036409 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6c908975-64df-4a74-81a8-d3e6f9d2d3f9 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:49.171484 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-6c908975-64df-4a74-81a8-d3e6f9d2d3f9 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:49.179596 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-6c908975-64df-4a74-81a8-d3e6f9d2d3f9 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899" status: 200 len: 1363 microversion: 2.1 time: 0.159845 Aug 31 01:27:49.180167 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 322/636] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:49 2022] GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:27:49.921882 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-3a673445-27a3-4083-94ed-2804f6fd2562 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:49.922484 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-3a673445-27a3-4083-94ed-2804f6fd2562 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:49.929127 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3a673445-27a3-4083-94ed-2804f6fd2562 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:49.929606 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3a673445-27a3-4083-94ed-2804f6fd2562 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:49.930038 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3a673445-27a3-4083-94ed-2804f6fd2562 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:49.930719 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3a673445-27a3-4083-94ed-2804f6fd2562 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:49.931222 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3a673445-27a3-4083-94ed-2804f6fd2562 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:49.931643 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3a673445-27a3-4083-94ed-2804f6fd2562 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:50.062385 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-3a673445-27a3-4083-94ed-2804f6fd2562 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:50.070780 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-3a673445-27a3-4083-94ed-2804f6fd2562 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:50.072211 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-3a673445-27a3-4083-94ed-2804f6fd2562 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:50.073479 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-3a673445-27a3-4083-94ed-2804f6fd2562 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1722 microversion: 2.20 time: 0.155570 Aug 31 01:27:50.074032 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 315/637] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:27:49 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 01:27:50.202140 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-c7dd61d6-1189-4d93-921a-d902b6a2a694 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:50.202785 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-c7dd61d6-1189-4d93-921a-d902b6a2a694 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: f29a15ea-aad6-4491-a2e4-602f9ee66899] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:50.209990 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c7dd61d6-1189-4d93-921a-d902b6a2a694 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:50.210477 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c7dd61d6-1189-4d93-921a-d902b6a2a694 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:50.210915 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c7dd61d6-1189-4d93-921a-d902b6a2a694 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:50.211616 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c7dd61d6-1189-4d93-921a-d902b6a2a694 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:50.212070 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c7dd61d6-1189-4d93-921a-d902b6a2a694 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:50.212497 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c7dd61d6-1189-4d93-921a-d902b6a2a694 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:50.613036 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-c7dd61d6-1189-4d93-921a-d902b6a2a694 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:50.622046 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-c7dd61d6-1189-4d93-921a-d902b6a2a694 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899" status: 200 len: 1363 microversion: 2.1 time: 0.424171 Aug 31 01:27:50.622626 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 323/638] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:50 2022] GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899 => generated 1363 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:27:51.098378 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-1572e344-9ba1-4dc3-bdd1-385c69a8b54e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:51.098985 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-1572e344-9ba1-4dc3-bdd1-385c69a8b54e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:51.105399 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1572e344-9ba1-4dc3-bdd1-385c69a8b54e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:51.105884 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1572e344-9ba1-4dc3-bdd1-385c69a8b54e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:51.106347 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1572e344-9ba1-4dc3-bdd1-385c69a8b54e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:51.107026 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1572e344-9ba1-4dc3-bdd1-385c69a8b54e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:51.107646 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1572e344-9ba1-4dc3-bdd1-385c69a8b54e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:51.108064 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1572e344-9ba1-4dc3-bdd1-385c69a8b54e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:51.236232 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-1572e344-9ba1-4dc3-bdd1-385c69a8b54e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:51.244705 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-1572e344-9ba1-4dc3-bdd1-385c69a8b54e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:51.246151 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-1572e344-9ba1-4dc3-bdd1-385c69a8b54e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:51.250047 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-1572e344-9ba1-4dc3-bdd1-385c69a8b54e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1722 microversion: 2.20 time: 0.153578 Aug 31 01:27:51.250047 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 316/639] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:27:51 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:27:51.643419 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-68775e1a-2cf7-4e36-88f5-167c6300d4ca tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:51.644187 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-68775e1a-2cf7-4e36-88f5-167c6300d4ca tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: f29a15ea-aad6-4491-a2e4-602f9ee66899] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:51.651040 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-68775e1a-2cf7-4e36-88f5-167c6300d4ca tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:51.651521 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-68775e1a-2cf7-4e36-88f5-167c6300d4ca tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:51.651955 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-68775e1a-2cf7-4e36-88f5-167c6300d4ca tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:51.652635 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-68775e1a-2cf7-4e36-88f5-167c6300d4ca tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:51.653111 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-68775e1a-2cf7-4e36-88f5-167c6300d4ca tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:51.653531 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-68775e1a-2cf7-4e36-88f5-167c6300d4ca tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:51.783744 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-68775e1a-2cf7-4e36-88f5-167c6300d4ca tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:51.791552 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-68775e1a-2cf7-4e36-88f5-167c6300d4ca tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899" status: 200 len: 1549 microversion: 2.1 time: 0.152023 Aug 31 01:27:51.792121 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 324/640] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:27:51 2022] GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899 => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:27:51.812153 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-a8e3e130-19fb-4f5b-81b1-d0c8ca484c47 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:51.812652 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-a8e3e130-19fb-4f5b-81b1-d0c8ca484c47 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: f29a15ea-aad6-4491-a2e4-602f9ee66899] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:51.819040 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a8e3e130-19fb-4f5b-81b1-d0c8ca484c47 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:51.819515 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a8e3e130-19fb-4f5b-81b1-d0c8ca484c47 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:51.819942 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a8e3e130-19fb-4f5b-81b1-d0c8ca484c47 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:51.820616 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a8e3e130-19fb-4f5b-81b1-d0c8ca484c47 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:51.821099 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a8e3e130-19fb-4f5b-81b1-d0c8ca484c47 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:51.821514 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a8e3e130-19fb-4f5b-81b1-d0c8ca484c47 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:51.838353 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell1:SELECT=100 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:27:51.897029 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-a8e3e130-19fb-4f5b-81b1-d0c8ca484c47 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088840 Aug 31 01:27:51.898039 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 317/641] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Aug 31 01:27:51 2022] GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:27:52.270687 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-908354f8-e0d6-48dc-a2d3-5cb5507f8f0e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:52.271300 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-908354f8-e0d6-48dc-a2d3-5cb5507f8f0e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:52.277123 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-908354f8-e0d6-48dc-a2d3-5cb5507f8f0e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:52.277606 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-908354f8-e0d6-48dc-a2d3-5cb5507f8f0e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:52.278041 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-908354f8-e0d6-48dc-a2d3-5cb5507f8f0e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:52.278860 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-908354f8-e0d6-48dc-a2d3-5cb5507f8f0e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:52.279180 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-908354f8-e0d6-48dc-a2d3-5cb5507f8f0e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:52.279597 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-908354f8-e0d6-48dc-a2d3-5cb5507f8f0e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:52.460542 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-908354f8-e0d6-48dc-a2d3-5cb5507f8f0e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:52.468711 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-908354f8-e0d6-48dc-a2d3-5cb5507f8f0e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:52.470153 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-908354f8-e0d6-48dc-a2d3-5cb5507f8f0e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:52.471295 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-908354f8-e0d6-48dc-a2d3-5cb5507f8f0e tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1722 microversion: 2.20 time: 0.204526 Aug 31 01:27:52.471847 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 325/642] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:27:52 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1722 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:27:53.077716 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-9705d73b-0c35-4d2a-ac6a-a571362a4676 req-0b2fe68d-8834-4e99-b2cf-6a9e3ffec16e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f29a15ea-aad6-4491-a2e4-602f9ee66899", "tag": "cdfb0f64-8b81-4f78-aca5-823b4f781b7b"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:27:53.088065 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-9705d73b-0c35-4d2a-ac6a-a571362a4676 req-0b2fe68d-8834-4e99-b2cf-6a9e3ffec16e service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:53.088548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-9705d73b-0c35-4d2a-ac6a-a571362a4676 req-0b2fe68d-8834-4e99-b2cf-6a9e3ffec16e service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:53.089022 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-9705d73b-0c35-4d2a-ac6a-a571362a4676 req-0b2fe68d-8834-4e99-b2cf-6a9e3ffec16e service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:53.101049 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-9705d73b-0c35-4d2a-ac6a-a571362a4676 req-0b2fe68d-8834-4e99-b2cf-6a9e3ffec16e service nova] Creating event network-changed:cdfb0f64-8b81-4f78-aca5-823b4f781b7b for instance f29a15ea-aad6-4491-a2e4-602f9ee66899 on hv-cinder-85528 Aug 31 01:27:53.105959 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-9705d73b-0c35-4d2a-ac6a-a571362a4676 req-0b2fe68d-8834-4e99-b2cf-6a9e3ffec16e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158633 Aug 31 01:27:53.106605 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 318/643] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:27:53.494991 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-21de2d5a-e07b-4339-ac14-79cc069f307f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:53.496893 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-21de2d5a-e07b-4339-ac14-79cc069f307f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:53.503485 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-21de2d5a-e07b-4339-ac14-79cc069f307f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:53.504027 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-21de2d5a-e07b-4339-ac14-79cc069f307f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:53.504456 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-21de2d5a-e07b-4339-ac14-79cc069f307f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:53.505350 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-21de2d5a-e07b-4339-ac14-79cc069f307f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:53.506328 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-21de2d5a-e07b-4339-ac14-79cc069f307f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:53.506606 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-21de2d5a-e07b-4339-ac14-79cc069f307f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:53.662224 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-21de2d5a-e07b-4339-ac14-79cc069f307f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:53.671673 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-21de2d5a-e07b-4339-ac14-79cc069f307f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:53.673473 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-21de2d5a-e07b-4339-ac14-79cc069f307f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:53.675006 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-21de2d5a-e07b-4339-ac14-79cc069f307f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1722 microversion: 2.20 time: 0.183776 Aug 31 01:27:53.675952 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 326/644] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:27:53 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:27:54.699582 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-7f651ea9-93a3-4c56-93a0-2fac6050591d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:54.700276 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-7f651ea9-93a3-4c56-93a0-2fac6050591d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:54.706675 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7f651ea9-93a3-4c56-93a0-2fac6050591d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:54.707183 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7f651ea9-93a3-4c56-93a0-2fac6050591d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:54.707622 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7f651ea9-93a3-4c56-93a0-2fac6050591d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:54.708310 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7f651ea9-93a3-4c56-93a0-2fac6050591d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:54.708787 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7f651ea9-93a3-4c56-93a0-2fac6050591d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:54.709207 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7f651ea9-93a3-4c56-93a0-2fac6050591d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:54.842202 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-7f651ea9-93a3-4c56-93a0-2fac6050591d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:54.850833 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-7f651ea9-93a3-4c56-93a0-2fac6050591d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:54.852277 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-7f651ea9-93a3-4c56-93a0-2fac6050591d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:54.853468 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-7f651ea9-93a3-4c56-93a0-2fac6050591d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1722 microversion: 2.20 time: 0.158735 Aug 31 01:27:54.854015 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 319/645] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:27:54 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:27:55.877055 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-e84586f9-ba14-4b48-85ac-2884e09d12eb tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:55.877727 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-e84586f9-ba14-4b48-85ac-2884e09d12eb tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:55.884704 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e84586f9-ba14-4b48-85ac-2884e09d12eb tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:55.885206 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e84586f9-ba14-4b48-85ac-2884e09d12eb tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:55.885635 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e84586f9-ba14-4b48-85ac-2884e09d12eb tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:55.886309 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e84586f9-ba14-4b48-85ac-2884e09d12eb tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:55.886751 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e84586f9-ba14-4b48-85ac-2884e09d12eb tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:55.887165 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e84586f9-ba14-4b48-85ac-2884e09d12eb tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:56.020280 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-e84586f9-ba14-4b48-85ac-2884e09d12eb tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:56.029281 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-e84586f9-ba14-4b48-85ac-2884e09d12eb tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:56.030698 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-e84586f9-ba14-4b48-85ac-2884e09d12eb tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:56.031892 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-e84586f9-ba14-4b48-85ac-2884e09d12eb tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1722 microversion: 2.20 time: 0.158812 Aug 31 01:27:56.032442 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 327/646] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:27:55 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:27:57.054741 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-18f06159-18c8-47fa-b2e0-cdc7cd62d9c1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:57.055350 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-18f06159-18c8-47fa-b2e0-cdc7cd62d9c1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:57.062056 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-18f06159-18c8-47fa-b2e0-cdc7cd62d9c1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:57.062589 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-18f06159-18c8-47fa-b2e0-cdc7cd62d9c1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:57.063022 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-18f06159-18c8-47fa-b2e0-cdc7cd62d9c1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:57.063905 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-18f06159-18c8-47fa-b2e0-cdc7cd62d9c1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:57.064363 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-18f06159-18c8-47fa-b2e0-cdc7cd62d9c1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:57.064931 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-18f06159-18c8-47fa-b2e0-cdc7cd62d9c1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:57.201138 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-18f06159-18c8-47fa-b2e0-cdc7cd62d9c1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:57.210466 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-18f06159-18c8-47fa-b2e0-cdc7cd62d9c1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:57.211903 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-18f06159-18c8-47fa-b2e0-cdc7cd62d9c1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:57.213113 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-18f06159-18c8-47fa-b2e0-cdc7cd62d9c1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1722 microversion: 2.20 time: 0.162351 Aug 31 01:27:57.213827 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 320/647] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:27:57 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:27:58.236129 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-837a8c8c-04de-4cae-b6fe-cb8fd16bb636 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:58.236747 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-837a8c8c-04de-4cae-b6fe-cb8fd16bb636 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:58.243204 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-837a8c8c-04de-4cae-b6fe-cb8fd16bb636 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:58.243681 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-837a8c8c-04de-4cae-b6fe-cb8fd16bb636 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:58.244118 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-837a8c8c-04de-4cae-b6fe-cb8fd16bb636 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:58.244830 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-837a8c8c-04de-4cae-b6fe-cb8fd16bb636 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:58.245281 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-837a8c8c-04de-4cae-b6fe-cb8fd16bb636 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:58.245700 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-837a8c8c-04de-4cae-b6fe-cb8fd16bb636 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:58.374906 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-837a8c8c-04de-4cae-b6fe-cb8fd16bb636 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:58.383602 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-837a8c8c-04de-4cae-b6fe-cb8fd16bb636 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:58.385066 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-837a8c8c-04de-4cae-b6fe-cb8fd16bb636 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:58.386218 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-837a8c8c-04de-4cae-b6fe-cb8fd16bb636 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1722 microversion: 2.20 time: 0.154109 Aug 31 01:27:58.386777 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 328/648] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:27:58 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:27:59.409583 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-f4e2e5ce-fd90-43f6-bead-ce92eff435c3 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:27:59.410678 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-f4e2e5ce-fd90-43f6-bead-ce92eff435c3 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:27:59.417402 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f4e2e5ce-fd90-43f6-bead-ce92eff435c3 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:59.417886 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f4e2e5ce-fd90-43f6-bead-ce92eff435c3 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:59.418327 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f4e2e5ce-fd90-43f6-bead-ce92eff435c3 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:59.419012 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f4e2e5ce-fd90-43f6-bead-ce92eff435c3 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:27:59.419460 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f4e2e5ce-fd90-43f6-bead-ce92eff435c3 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:27:59.419879 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f4e2e5ce-fd90-43f6-bead-ce92eff435c3 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:27:59.551848 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-f4e2e5ce-fd90-43f6-bead-ce92eff435c3 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:59.560147 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-f4e2e5ce-fd90-43f6-bead-ce92eff435c3 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:59.561728 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-f4e2e5ce-fd90-43f6-bead-ce92eff435c3 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:27:59.563142 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-f4e2e5ce-fd90-43f6-bead-ce92eff435c3 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1722 microversion: 2.20 time: 0.157505 Aug 31 01:27:59.563732 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 321/649] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:27:59 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:28:00.587655 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-d2b4563a-f96c-46da-a3bd-9c3735f42656 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:00.588390 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-d2b4563a-f96c-46da-a3bd-9c3735f42656 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:00.594960 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d2b4563a-f96c-46da-a3bd-9c3735f42656 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:00.596465 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d2b4563a-f96c-46da-a3bd-9c3735f42656 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:00.596465 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d2b4563a-f96c-46da-a3bd-9c3735f42656 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:00.596769 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d2b4563a-f96c-46da-a3bd-9c3735f42656 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:00.597912 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d2b4563a-f96c-46da-a3bd-9c3735f42656 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:00.598358 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d2b4563a-f96c-46da-a3bd-9c3735f42656 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:00.741873 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-d2b4563a-f96c-46da-a3bd-9c3735f42656 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:00.750120 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-d2b4563a-f96c-46da-a3bd-9c3735f42656 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:00.751574 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-d2b4563a-f96c-46da-a3bd-9c3735f42656 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:00.752784 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-d2b4563a-f96c-46da-a3bd-9c3735f42656 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1743 microversion: 2.20 time: 0.169175 Aug 31 01:28:00.754105 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 329/650] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:28:00 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1743 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:28:01.778466 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-0430de92-b4f6-48b9-931b-8ad1842becdc tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:01.779283 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-0430de92-b4f6-48b9-931b-8ad1842becdc tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:01.785623 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0430de92-b4f6-48b9-931b-8ad1842becdc tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:01.786178 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0430de92-b4f6-48b9-931b-8ad1842becdc tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:01.786695 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0430de92-b4f6-48b9-931b-8ad1842becdc tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:01.787456 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0430de92-b4f6-48b9-931b-8ad1842becdc tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:01.787965 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0430de92-b4f6-48b9-931b-8ad1842becdc tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:01.788578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0430de92-b4f6-48b9-931b-8ad1842becdc tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:01.933715 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-0430de92-b4f6-48b9-931b-8ad1842becdc tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:01.946167 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-0430de92-b4f6-48b9-931b-8ad1842becdc tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:01.947698 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-0430de92-b4f6-48b9-931b-8ad1842becdc tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:01.948917 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-0430de92-b4f6-48b9-931b-8ad1842becdc tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1738 microversion: 2.20 time: 0.174219 Aug 31 01:28:01.949975 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 322/651] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:28:01 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:28:02.440056 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [req-6ad9ab1e-636f-4f61-9eef-6450bb4cdee1 req-dac18088-c2d8-4693-9156-a6b1b163c0b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7311a59-7d10-4edb-be41-f6872e563e09", "name": "network-vif-plugged", "status": "completed", "tag": "1302084d-99f4-4cd1-8b6d-4a829a883993"}]} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:28:02.468372 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-6ad9ab1e-636f-4f61-9eef-6450bb4cdee1 req-dac18088-c2d8-4693-9156-a6b1b163c0b8 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:02.469278 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-6ad9ab1e-636f-4f61-9eef-6450bb4cdee1 req-dac18088-c2d8-4693-9156-a6b1b163c0b8 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:02.470461 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-6ad9ab1e-636f-4f61-9eef-6450bb4cdee1 req-dac18088-c2d8-4693-9156-a6b1b163c0b8 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:02.483226 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.compute.server_external_events [req-6ad9ab1e-636f-4f61-9eef-6450bb4cdee1 req-dac18088-c2d8-4693-9156-a6b1b163c0b8 service nova] Creating event network-vif-plugged:1302084d-99f4-4cd1-8b6d-4a829a883993 for instance b7311a59-7d10-4edb-be41-f6872e563e09 on hv-cinder-85528 Aug 31 01:28:02.490758 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [req-6ad9ab1e-636f-4f61-9eef-6450bb4cdee1 req-dac18088-c2d8-4693-9156-a6b1b163c0b8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057243 Aug 31 01:28:02.491830 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 330/652] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:28:02.973040 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-f3b34f38-75cf-4772-9637-c161ec91350a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:02.974293 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-f3b34f38-75cf-4772-9637-c161ec91350a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:02.980953 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f3b34f38-75cf-4772-9637-c161ec91350a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:02.981444 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f3b34f38-75cf-4772-9637-c161ec91350a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:02.984266 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f3b34f38-75cf-4772-9637-c161ec91350a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:02.984782 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f3b34f38-75cf-4772-9637-c161ec91350a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:02.985694 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f3b34f38-75cf-4772-9637-c161ec91350a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:02.985694 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f3b34f38-75cf-4772-9637-c161ec91350a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:03.137665 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-f3b34f38-75cf-4772-9637-c161ec91350a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:03.146449 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-f3b34f38-75cf-4772-9637-c161ec91350a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:03.147940 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-f3b34f38-75cf-4772-9637-c161ec91350a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:03.149137 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-f3b34f38-75cf-4772-9637-c161ec91350a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1738 microversion: 2.20 time: 0.180624 Aug 31 01:28:03.150600 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 323/653] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:28:02 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:28:04.182520 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-7dbead85-7bf8-4cf6-b7c3-f24acecd450d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:04.183949 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-7dbead85-7bf8-4cf6-b7c3-f24acecd450d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:04.195176 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7dbead85-7bf8-4cf6-b7c3-f24acecd450d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:04.195938 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7dbead85-7bf8-4cf6-b7c3-f24acecd450d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:04.203185 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7dbead85-7bf8-4cf6-b7c3-f24acecd450d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:04.203185 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7dbead85-7bf8-4cf6-b7c3-f24acecd450d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:04.203185 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7dbead85-7bf8-4cf6-b7c3-f24acecd450d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:04.203185 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7dbead85-7bf8-4cf6-b7c3-f24acecd450d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:04.370792 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-7dbead85-7bf8-4cf6-b7c3-f24acecd450d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:04.381899 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-7dbead85-7bf8-4cf6-b7c3-f24acecd450d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:04.383483 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-7dbead85-7bf8-4cf6-b7c3-f24acecd450d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:04.384788 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-7dbead85-7bf8-4cf6-b7c3-f24acecd450d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1738 microversion: 2.20 time: 0.211090 Aug 31 01:28:04.397481 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 331/654] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:28:04 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1738 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:28:05.410270 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-48c82ba2-9175-4b1e-a2e2-caf91873bad2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:05.410942 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-48c82ba2-9175-4b1e-a2e2-caf91873bad2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:05.418178 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-48c82ba2-9175-4b1e-a2e2-caf91873bad2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:05.418660 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-48c82ba2-9175-4b1e-a2e2-caf91873bad2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:05.419091 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-48c82ba2-9175-4b1e-a2e2-caf91873bad2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:05.419767 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-48c82ba2-9175-4b1e-a2e2-caf91873bad2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:05.420216 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-48c82ba2-9175-4b1e-a2e2-caf91873bad2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:05.420633 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-48c82ba2-9175-4b1e-a2e2-caf91873bad2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:05.565604 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-48c82ba2-9175-4b1e-a2e2-caf91873bad2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:05.573778 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-48c82ba2-9175-4b1e-a2e2-caf91873bad2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:05.575219 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-48c82ba2-9175-4b1e-a2e2-caf91873bad2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:05.576402 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-48c82ba2-9175-4b1e-a2e2-caf91873bad2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1738 microversion: 2.20 time: 0.170625 Aug 31 01:28:05.576999 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 324/655] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:28:05 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:28:06.603946 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-b02e028c-86a4-42d8-a697-8e5b650b072d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:06.605074 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-b02e028c-86a4-42d8-a697-8e5b650b072d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:06.612515 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b02e028c-86a4-42d8-a697-8e5b650b072d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:06.613953 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b02e028c-86a4-42d8-a697-8e5b650b072d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:06.617254 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b02e028c-86a4-42d8-a697-8e5b650b072d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:06.618159 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b02e028c-86a4-42d8-a697-8e5b650b072d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:06.618908 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b02e028c-86a4-42d8-a697-8e5b650b072d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:06.619430 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b02e028c-86a4-42d8-a697-8e5b650b072d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:06.782790 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-b02e028c-86a4-42d8-a697-8e5b650b072d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:06.792666 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-b02e028c-86a4-42d8-a697-8e5b650b072d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:06.797683 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-b02e028c-86a4-42d8-a697-8e5b650b072d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:06.801352 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-b02e028c-86a4-42d8-a697-8e5b650b072d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1738 microversion: 2.20 time: 0.205640 Aug 31 01:28:06.805919 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 332/656] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:28:06 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1738 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:28:07.828402 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-20ca818a-3ef1-4c16-bdcd-4a4a9b1e7dd2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:07.830011 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-20ca818a-3ef1-4c16-bdcd-4a4a9b1e7dd2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:07.847195 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-20ca818a-3ef1-4c16-bdcd-4a4a9b1e7dd2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:07.849314 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-20ca818a-3ef1-4c16-bdcd-4a4a9b1e7dd2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:07.853991 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-20ca818a-3ef1-4c16-bdcd-4a4a9b1e7dd2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:07.858739 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-20ca818a-3ef1-4c16-bdcd-4a4a9b1e7dd2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:07.859335 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-20ca818a-3ef1-4c16-bdcd-4a4a9b1e7dd2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:07.859869 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-20ca818a-3ef1-4c16-bdcd-4a4a9b1e7dd2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:08.191877 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-20ca818a-3ef1-4c16-bdcd-4a4a9b1e7dd2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:08.199337 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-20ca818a-3ef1-4c16-bdcd-4a4a9b1e7dd2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:08.200086 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-20ca818a-3ef1-4c16-bdcd-4a4a9b1e7dd2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:08.205411 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-20ca818a-3ef1-4c16-bdcd-4a4a9b1e7dd2 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1738 microversion: 2.20 time: 0.381657 Aug 31 01:28:08.206881 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 325/657] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:28:07 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1738 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 01:28:09.234635 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-84241ef6-aab5-4c80-836d-378b79b3c960 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:09.236693 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-84241ef6-aab5-4c80-836d-378b79b3c960 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:09.251782 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-84241ef6-aab5-4c80-836d-378b79b3c960 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:09.252644 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-84241ef6-aab5-4c80-836d-378b79b3c960 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:09.257057 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-84241ef6-aab5-4c80-836d-378b79b3c960 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:09.259004 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-84241ef6-aab5-4c80-836d-378b79b3c960 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:09.261117 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-84241ef6-aab5-4c80-836d-378b79b3c960 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:09.262832 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-84241ef6-aab5-4c80-836d-378b79b3c960 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:09.563926 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-84241ef6-aab5-4c80-836d-378b79b3c960 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:09.577461 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-84241ef6-aab5-4c80-836d-378b79b3c960 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:09.579901 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-84241ef6-aab5-4c80-836d-378b79b3c960 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:09.581493 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-84241ef6-aab5-4c80-836d-378b79b3c960 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1738 microversion: 2.20 time: 0.354237 Aug 31 01:28:09.582316 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 333/658] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:28:09 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1738 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:28:10.606352 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-e989bb05-b9b3-4063-9ec1-5698469d4a49 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:10.606993 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-e989bb05-b9b3-4063-9ec1-5698469d4a49 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:10.621668 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e989bb05-b9b3-4063-9ec1-5698469d4a49 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:10.622167 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e989bb05-b9b3-4063-9ec1-5698469d4a49 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:10.622733 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e989bb05-b9b3-4063-9ec1-5698469d4a49 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:10.623450 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e989bb05-b9b3-4063-9ec1-5698469d4a49 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:10.623951 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e989bb05-b9b3-4063-9ec1-5698469d4a49 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:10.624369 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e989bb05-b9b3-4063-9ec1-5698469d4a49 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:10.808436 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-e989bb05-b9b3-4063-9ec1-5698469d4a49 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:10.818821 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-e989bb05-b9b3-4063-9ec1-5698469d4a49 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:10.825685 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-e989bb05-b9b3-4063-9ec1-5698469d4a49 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:10.825685 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-e989bb05-b9b3-4063-9ec1-5698469d4a49 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1738 microversion: 2.20 time: 0.219488 Aug 31 01:28:10.825685 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 326/659] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:28:10 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1738 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:28:11.851306 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-b5d287b5-c124-4733-ac46-0e3a7177b547 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:11.854739 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-b5d287b5-c124-4733-ac46-0e3a7177b547 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:11.867589 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b5d287b5-c124-4733-ac46-0e3a7177b547 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:11.868366 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b5d287b5-c124-4733-ac46-0e3a7177b547 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:11.869575 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b5d287b5-c124-4733-ac46-0e3a7177b547 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:11.870469 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b5d287b5-c124-4733-ac46-0e3a7177b547 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:11.871080 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b5d287b5-c124-4733-ac46-0e3a7177b547 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:11.871662 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b5d287b5-c124-4733-ac46-0e3a7177b547 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:12.086191 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-b5d287b5-c124-4733-ac46-0e3a7177b547 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:12.099685 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-b5d287b5-c124-4733-ac46-0e3a7177b547 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:12.101453 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-b5d287b5-c124-4733-ac46-0e3a7177b547 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:12.103079 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-b5d287b5-c124-4733-ac46-0e3a7177b547 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1738 microversion: 2.20 time: 0.257939 Aug 31 01:28:12.104907 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 334/660] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:28:11 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1738 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:28:13.139484 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-9141d160-d70f-40e0-bf4d-d4624d5232b1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:13.141578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-9141d160-d70f-40e0-bf4d-d4624d5232b1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:13.152685 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:28:13.154929 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9141d160-d70f-40e0-bf4d-d4624d5232b1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:13.156313 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9141d160-d70f-40e0-bf4d-d4624d5232b1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:13.156313 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9141d160-d70f-40e0-bf4d-d4624d5232b1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:13.158010 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9141d160-d70f-40e0-bf4d-d4624d5232b1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:13.158555 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9141d160-d70f-40e0-bf4d-d4624d5232b1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:13.159477 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9141d160-d70f-40e0-bf4d-d4624d5232b1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:13.401866 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-9141d160-d70f-40e0-bf4d-d4624d5232b1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:13.409791 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-9141d160-d70f-40e0-bf4d-d4624d5232b1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:13.415918 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-9141d160-d70f-40e0-bf4d-d4624d5232b1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:13.417194 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-9141d160-d70f-40e0-bf4d-d4624d5232b1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1738 microversion: 2.20 time: 0.289905 Aug 31 01:28:13.437148 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 327/661] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:28:13 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1738 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:28:14.444562 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-de2cb364-2524-45dd-abac-fee833487eb0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:14.445273 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-de2cb364-2524-45dd-abac-fee833487eb0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:14.448701 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_api:SELECT=50 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:28:14.452034 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-de2cb364-2524-45dd-abac-fee833487eb0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:14.452508 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-de2cb364-2524-45dd-abac-fee833487eb0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:14.452982 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-de2cb364-2524-45dd-abac-fee833487eb0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:14.453733 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-de2cb364-2524-45dd-abac-fee833487eb0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:14.454179 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-de2cb364-2524-45dd-abac-fee833487eb0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:14.454849 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-de2cb364-2524-45dd-abac-fee833487eb0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:14.459578 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell1:SELECT=100 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:28:14.614698 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-de2cb364-2524-45dd-abac-fee833487eb0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:14.623239 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-de2cb364-2524-45dd-abac-fee833487eb0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:14.624672 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-de2cb364-2524-45dd-abac-fee833487eb0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:14.625857 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-de2cb364-2524-45dd-abac-fee833487eb0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1738 microversion: 2.20 time: 0.185645 Aug 31 01:28:14.626426 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 335/662] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:28:14 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1738 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:28:15.650830 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-ad826a3a-9f9e-4c61-afd3-ea906649eb34 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:15.656898 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-ad826a3a-9f9e-4c61-afd3-ea906649eb34 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:15.660042 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ad826a3a-9f9e-4c61-afd3-ea906649eb34 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:15.660538 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ad826a3a-9f9e-4c61-afd3-ea906649eb34 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:15.661001 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ad826a3a-9f9e-4c61-afd3-ea906649eb34 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:15.661708 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ad826a3a-9f9e-4c61-afd3-ea906649eb34 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:15.662167 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ad826a3a-9f9e-4c61-afd3-ea906649eb34 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:15.662729 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ad826a3a-9f9e-4c61-afd3-ea906649eb34 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:15.865863 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-ad826a3a-9f9e-4c61-afd3-ea906649eb34 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:15.876230 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-ad826a3a-9f9e-4c61-afd3-ea906649eb34 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:15.878782 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-ad826a3a-9f9e-4c61-afd3-ea906649eb34 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:15.880153 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-ad826a3a-9f9e-4c61-afd3-ea906649eb34 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1720 microversion: 2.20 time: 0.233216 Aug 31 01:28:15.881013 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 328/663] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:28:15 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1720 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:28:16.912155 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-fece475b-e023-4ded-b249-3231c8293d1a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:16.913330 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-fece475b-e023-4ded-b249-3231c8293d1a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:16.921795 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fece475b-e023-4ded-b249-3231c8293d1a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:16.922682 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fece475b-e023-4ded-b249-3231c8293d1a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:16.923286 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fece475b-e023-4ded-b249-3231c8293d1a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:16.923807 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fece475b-e023-4ded-b249-3231c8293d1a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:16.924262 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fece475b-e023-4ded-b249-3231c8293d1a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:16.924732 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fece475b-e023-4ded-b249-3231c8293d1a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:17.212616 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-fece475b-e023-4ded-b249-3231c8293d1a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:17.227164 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-fece475b-e023-4ded-b249-3231c8293d1a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:17.229290 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-fece475b-e023-4ded-b249-3231c8293d1a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:17.231225 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-fece475b-e023-4ded-b249-3231c8293d1a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1720 microversion: 2.20 time: 0.330459 Aug 31 01:28:17.245686 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 336/664] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:28:16 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1720 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:28:18.254906 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-7f2e6938-6bc7-478d-9ab0-c21d3b59b7c9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:18.255442 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-7f2e6938-6bc7-478d-9ab0-c21d3b59b7c9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:18.261922 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7f2e6938-6bc7-478d-9ab0-c21d3b59b7c9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:18.262411 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7f2e6938-6bc7-478d-9ab0-c21d3b59b7c9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:18.262844 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7f2e6938-6bc7-478d-9ab0-c21d3b59b7c9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:18.263534 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7f2e6938-6bc7-478d-9ab0-c21d3b59b7c9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:18.263984 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7f2e6938-6bc7-478d-9ab0-c21d3b59b7c9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:18.264405 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7f2e6938-6bc7-478d-9ab0-c21d3b59b7c9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:18.753508 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-7f2e6938-6bc7-478d-9ab0-c21d3b59b7c9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:18.766198 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-7f2e6938-6bc7-478d-9ab0-c21d3b59b7c9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:18.767711 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-7f2e6938-6bc7-478d-9ab0-c21d3b59b7c9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:18.769540 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-7f2e6938-6bc7-478d-9ab0-c21d3b59b7c9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1663 microversion: 2.20 time: 0.518692 Aug 31 01:28:18.770539 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 329/665] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:28:18 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1663 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:28:18.797046 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-fcd51f82-e552-4f50-a08e-9f2a3e59b6b9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "74434c5c-574e-4595-b74f-1459d2040ed4"}} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:28:18.800034 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-fcd51f82-e552-4f50-a08e-9f2a3e59b6b9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:18.808051 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fcd51f82-e552-4f50-a08e-9f2a3e59b6b9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:18.809828 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fcd51f82-e552-4f50-a08e-9f2a3e59b6b9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:18.810485 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fcd51f82-e552-4f50-a08e-9f2a3e59b6b9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:18.811545 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fcd51f82-e552-4f50-a08e-9f2a3e59b6b9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:18.812235 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fcd51f82-e552-4f50-a08e-9f2a3e59b6b9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:18.813169 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fcd51f82-e552-4f50-a08e-9f2a3e59b6b9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:18.939843 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [req-76a0645a-6a0d-4ee2-905d-750c402adbf8 req-b56abec3-2d72-4e41-be9e-13f871e3692a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7311a59-7d10-4edb-be41-f6872e563e09", "name": "network-vif-unplugged", "status": "completed", "tag": "1302084d-99f4-4cd1-8b6d-4a829a883993"}]} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:28:18.950428 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-76a0645a-6a0d-4ee2-905d-750c402adbf8 req-b56abec3-2d72-4e41-be9e-13f871e3692a service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:18.950916 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-76a0645a-6a0d-4ee2-905d-750c402adbf8 req-b56abec3-2d72-4e41-be9e-13f871e3692a service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:18.951359 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-76a0645a-6a0d-4ee2-905d-750c402adbf8 req-b56abec3-2d72-4e41-be9e-13f871e3692a service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:18.969795 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.compute.server_external_events [req-76a0645a-6a0d-4ee2-905d-750c402adbf8 req-b56abec3-2d72-4e41-be9e-13f871e3692a service nova] Unable to find a host for instance b7311a59-7d10-4edb-be41-f6872e563e09. Dropping event network-vif-unplugged {{(pid=121026) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 31 01:28:18.970988 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [req-76a0645a-6a0d-4ee2-905d-750c402adbf8 req-b56abec3-2d72-4e41-be9e-13f871e3692a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.315559 Aug 31 01:28:18.976360 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 337/666] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 321 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 31 01:28:19.910932 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-fcd51f82-e552-4f50-a08e-9f2a3e59b6b9 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "POST /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.118394 Aug 31 01:28:19.916881 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 330/667] 10.222.0.20 () {62 vars in 1364 bytes} [Wed Aug 31 01:28:18 2022] POST /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09/os-volume_attachments => generated 188 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 01:28:20.057382 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-44d8c326-3395-4ae8-959f-112f8fb6e8de tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:20.059682 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-44d8c326-3395-4ae8-959f-112f8fb6e8de tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:20.066809 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-44d8c326-3395-4ae8-959f-112f8fb6e8de tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:20.070361 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-44d8c326-3395-4ae8-959f-112f8fb6e8de tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:20.070361 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-44d8c326-3395-4ae8-959f-112f8fb6e8de tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:20.070361 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-44d8c326-3395-4ae8-959f-112f8fb6e8de tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:20.070361 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-44d8c326-3395-4ae8-959f-112f8fb6e8de tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:20.070882 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-44d8c326-3395-4ae8-959f-112f8fb6e8de tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:20.675979 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-44d8c326-3395-4ae8-959f-112f8fb6e8de tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09/os-volume_attachments/74434c5c-574e-4595-b74f-1459d2040ed4" status: 202 len: 0 microversion: 2.20 time: 0.622849 Aug 31 01:28:20.679981 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 338/668] 10.222.0.20 () {60 vars in 1457 bytes} [Wed Aug 31 01:28:20 2022] DELETE /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09/os-volume_attachments/74434c5c-574e-4595-b74f-1459d2040ed4 => generated 0 bytes in 628 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 01:28:20.745285 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-2a82f88f-d5bb-404c-b558-8f495606defb tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:28:20.746242 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-2a82f88f-d5bb-404c-b558-8f495606defb tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:20.757213 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2a82f88f-d5bb-404c-b558-8f495606defb tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:20.757801 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2a82f88f-d5bb-404c-b558-8f495606defb tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:20.758346 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2a82f88f-d5bb-404c-b558-8f495606defb tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:20.759621 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2a82f88f-d5bb-404c-b558-8f495606defb tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:20.760470 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2a82f88f-d5bb-404c-b558-8f495606defb tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:20.761130 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2a82f88f-d5bb-404c-b558-8f495606defb tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:20.810185 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-2a82f88f-d5bb-404c-b558-8f495606defb tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121025) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 01:28:20.951026 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:28:21.128539 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-2a82f88f-d5bb-404c-b558-8f495606defb tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "POST /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09/action" status: 202 len: 0 microversion: 2.20 time: 0.386622 Aug 31 01:28:21.130113 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 331/669] 10.222.0.20 () {62 vars in 1319 bytes} [Wed Aug 31 01:28:20 2022] POST /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09/action => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 01:28:21.140232 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-45f6a168-0e73-4ccc-a9b4-4bb8d161ae6d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:21.140232 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-45f6a168-0e73-4ccc-a9b4-4bb8d161ae6d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:21.146323 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-45f6a168-0e73-4ccc-a9b4-4bb8d161ae6d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:21.147029 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-45f6a168-0e73-4ccc-a9b4-4bb8d161ae6d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:21.147635 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-45f6a168-0e73-4ccc-a9b4-4bb8d161ae6d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:21.149077 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-45f6a168-0e73-4ccc-a9b4-4bb8d161ae6d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:21.149720 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-45f6a168-0e73-4ccc-a9b4-4bb8d161ae6d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:21.150311 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-45f6a168-0e73-4ccc-a9b4-4bb8d161ae6d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:21.310768 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-45f6a168-0e73-4ccc-a9b4-4bb8d161ae6d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:21.328037 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-45f6a168-0e73-4ccc-a9b4-4bb8d161ae6d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:21.333080 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-45f6a168-0e73-4ccc-a9b4-4bb8d161ae6d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:21.335628 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-45f6a168-0e73-4ccc-a9b4-4bb8d161ae6d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1671 microversion: 2.20 time: 0.201680 Aug 31 01:28:21.341063 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 339/670] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:28:21 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1671 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:28:22.371991 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-79875e82-a48c-4ee5-84fa-9dfac19dd5af tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:22.372619 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-79875e82-a48c-4ee5-84fa-9dfac19dd5af tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:22.388130 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-79875e82-a48c-4ee5-84fa-9dfac19dd5af tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:22.388639 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-79875e82-a48c-4ee5-84fa-9dfac19dd5af tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:22.391705 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-79875e82-a48c-4ee5-84fa-9dfac19dd5af tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:22.392418 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-79875e82-a48c-4ee5-84fa-9dfac19dd5af tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:22.393093 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-79875e82-a48c-4ee5-84fa-9dfac19dd5af tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:22.394295 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-79875e82-a48c-4ee5-84fa-9dfac19dd5af tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:22.594189 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-79875e82-a48c-4ee5-84fa-9dfac19dd5af tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:22.604367 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-79875e82-a48c-4ee5-84fa-9dfac19dd5af tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:22.606779 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-79875e82-a48c-4ee5-84fa-9dfac19dd5af tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:22.609142 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-79875e82-a48c-4ee5-84fa-9dfac19dd5af tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1671 microversion: 2.20 time: 0.250432 Aug 31 01:28:22.609709 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 332/671] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:28:22 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1671 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:28:23.633323 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-22869f92-632e-4851-a12d-8e1e30379369 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:23.634601 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-22869f92-632e-4851-a12d-8e1e30379369 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:23.643980 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-22869f92-632e-4851-a12d-8e1e30379369 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:23.644680 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-22869f92-632e-4851-a12d-8e1e30379369 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:23.645623 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-22869f92-632e-4851-a12d-8e1e30379369 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:23.647572 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-22869f92-632e-4851-a12d-8e1e30379369 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:23.647572 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-22869f92-632e-4851-a12d-8e1e30379369 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:23.648065 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-22869f92-632e-4851-a12d-8e1e30379369 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:23.815630 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-22869f92-632e-4851-a12d-8e1e30379369 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:23.824189 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-22869f92-632e-4851-a12d-8e1e30379369 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:23.825254 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-22869f92-632e-4851-a12d-8e1e30379369 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:23.826682 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-22869f92-632e-4851-a12d-8e1e30379369 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1729 microversion: 2.20 time: 0.199274 Aug 31 01:28:23.827232 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 340/672] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:28:23 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1729 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 01:28:24.657736 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-428fe96f-dbb5-463a-8c08-ec695cee66df tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:24.658295 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-428fe96f-dbb5-463a-8c08-ec695cee66df tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:24.666221 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-428fe96f-dbb5-463a-8c08-ec695cee66df tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:24.667064 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-428fe96f-dbb5-463a-8c08-ec695cee66df tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:24.667718 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-428fe96f-dbb5-463a-8c08-ec695cee66df tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:24.668644 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-428fe96f-dbb5-463a-8c08-ec695cee66df tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:24.669348 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-428fe96f-dbb5-463a-8c08-ec695cee66df tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:24.669984 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-428fe96f-dbb5-463a-8c08-ec695cee66df tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:24.703240 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-428fe96f-dbb5-463a-8c08-ec695cee66df tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac/ips" status: 200 len: 149 microversion: 2.1 time: 0.049245 Aug 31 01:28:24.705951 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 333/673] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Aug 31 01:28:24 2022] GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac/ips => generated 149 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:28:24.853997 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-c41e37ea-9ae6-469b-a98a-ade2d19cf511 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:24.855499 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-c41e37ea-9ae6-469b-a98a-ade2d19cf511 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:24.868738 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c41e37ea-9ae6-469b-a98a-ade2d19cf511 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:24.870015 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c41e37ea-9ae6-469b-a98a-ade2d19cf511 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:24.871122 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c41e37ea-9ae6-469b-a98a-ade2d19cf511 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:24.872153 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c41e37ea-9ae6-469b-a98a-ade2d19cf511 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:24.872968 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c41e37ea-9ae6-469b-a98a-ade2d19cf511 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:24.873674 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c41e37ea-9ae6-469b-a98a-ade2d19cf511 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:25.067045 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-c41e37ea-9ae6-469b-a98a-ade2d19cf511 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:25.084679 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-c41e37ea-9ae6-469b-a98a-ade2d19cf511 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:25.087665 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-c41e37ea-9ae6-469b-a98a-ade2d19cf511 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:25.089496 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-c41e37ea-9ae6-469b-a98a-ade2d19cf511 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1729 microversion: 2.20 time: 0.242940 Aug 31 01:28:25.091058 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 341/674] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:28:24 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1729 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:28:26.122112 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-1b98ee9c-f96b-4e97-b64a-ad05b22a27cd tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:26.123068 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-1b98ee9c-f96b-4e97-b64a-ad05b22a27cd tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:26.132985 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1b98ee9c-f96b-4e97-b64a-ad05b22a27cd tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:26.133564 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1b98ee9c-f96b-4e97-b64a-ad05b22a27cd tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:26.134248 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1b98ee9c-f96b-4e97-b64a-ad05b22a27cd tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:26.137473 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1b98ee9c-f96b-4e97-b64a-ad05b22a27cd tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:26.141648 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1b98ee9c-f96b-4e97-b64a-ad05b22a27cd tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:26.142202 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1b98ee9c-f96b-4e97-b64a-ad05b22a27cd tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:26.385189 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-1acd08a0-2173-49a0-922e-fbaed8c51494 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d628683-1def-4cc5-91c3-4c028e2fad55"}} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:28:26.387958 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-1b98ee9c-f96b-4e97-b64a-ad05b22a27cd tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:26.388624 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-1acd08a0-2173-49a0-922e-fbaed8c51494 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:26.396672 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1acd08a0-2173-49a0-922e-fbaed8c51494 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:26.403198 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1acd08a0-2173-49a0-922e-fbaed8c51494 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:26.403198 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1acd08a0-2173-49a0-922e-fbaed8c51494 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:26.403198 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1acd08a0-2173-49a0-922e-fbaed8c51494 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:26.403198 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1acd08a0-2173-49a0-922e-fbaed8c51494 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:26.403540 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1acd08a0-2173-49a0-922e-fbaed8c51494 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:26.403615 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-1b98ee9c-f96b-4e97-b64a-ad05b22a27cd tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:26.403615 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-1b98ee9c-f96b-4e97-b64a-ad05b22a27cd tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:26.404576 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-1b98ee9c-f96b-4e97-b64a-ad05b22a27cd tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1729 microversion: 2.20 time: 0.292556 Aug 31 01:28:26.418127 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 334/675] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:28:26 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1729 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:28:27.432288 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-0b9942de-dc6a-4abe-aa22-ea4122585de3 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:27.433449 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-0b9942de-dc6a-4abe-aa22-ea4122585de3 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:27.459370 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0b9942de-dc6a-4abe-aa22-ea4122585de3 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:27.460867 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0b9942de-dc6a-4abe-aa22-ea4122585de3 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:27.460991 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0b9942de-dc6a-4abe-aa22-ea4122585de3 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:27.462200 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0b9942de-dc6a-4abe-aa22-ea4122585de3 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:27.463029 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0b9942de-dc6a-4abe-aa22-ea4122585de3 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:27.463781 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0b9942de-dc6a-4abe-aa22-ea4122585de3 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:27.733847 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-0b9942de-dc6a-4abe-aa22-ea4122585de3 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:27.745308 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-0b9942de-dc6a-4abe-aa22-ea4122585de3 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:27.747120 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-0b9942de-dc6a-4abe-aa22-ea4122585de3 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:27.748368 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-0b9942de-dc6a-4abe-aa22-ea4122585de3 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1729 microversion: 2.20 time: 0.322304 Aug 31 01:28:27.749157 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 335/676] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:28:27 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1729 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 01:28:27.958419 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-1acd08a0-2173-49a0-922e-fbaed8c51494 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "POST /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.577360 Aug 31 01:28:27.960472 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 342/677] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 31 01:28:26 2022] POST /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac/os-volume_attachments => generated 194 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:28:28.778932 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-7a147b88-9b8c-40eb-a392-4d5615207da4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:28.781286 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-7a147b88-9b8c-40eb-a392-4d5615207da4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:28.800641 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7a147b88-9b8c-40eb-a392-4d5615207da4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:28.801425 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7a147b88-9b8c-40eb-a392-4d5615207da4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:28.802073 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7a147b88-9b8c-40eb-a392-4d5615207da4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:28.802984 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7a147b88-9b8c-40eb-a392-4d5615207da4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:28.803633 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7a147b88-9b8c-40eb-a392-4d5615207da4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:28.804229 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7a147b88-9b8c-40eb-a392-4d5615207da4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:29.044671 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-7a147b88-9b8c-40eb-a392-4d5615207da4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:29.053335 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-5bc5c4ff-36a6-47d0-9cbe-81966c5dbd7d tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:29.058513 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-5bc5c4ff-36a6-47d0-9cbe-81966c5dbd7d tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: f29a15ea-aad6-4491-a2e4-602f9ee66899] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:29.064315 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-7a147b88-9b8c-40eb-a392-4d5615207da4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:29.067411 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5bc5c4ff-36a6-47d0-9cbe-81966c5dbd7d tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:29.068223 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5bc5c4ff-36a6-47d0-9cbe-81966c5dbd7d tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:29.068904 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5bc5c4ff-36a6-47d0-9cbe-81966c5dbd7d tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:29.069848 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5bc5c4ff-36a6-47d0-9cbe-81966c5dbd7d tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:29.070120 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-7a147b88-9b8c-40eb-a392-4d5615207da4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:29.070932 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5bc5c4ff-36a6-47d0-9cbe-81966c5dbd7d tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:29.071562 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5bc5c4ff-36a6-47d0-9cbe-81966c5dbd7d tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:29.074151 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-7a147b88-9b8c-40eb-a392-4d5615207da4 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1729 microversion: 2.20 time: 0.299192 Aug 31 01:28:29.086359 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 336/678] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:28:28 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1729 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:28:29.138176 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-5bc5c4ff-36a6-47d0-9cbe-81966c5dbd7d tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899/ips" status: 200 len: 146 microversion: 2.1 time: 0.090392 Aug 31 01:28:29.161070 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 343/679] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Aug 31 01:28:29 2022] GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899/ips => generated 146 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:28:30.109510 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-c548f8a7-7e12-4b9b-99d5-07d8ea4f5166 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:30.110087 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-c548f8a7-7e12-4b9b-99d5-07d8ea4f5166 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:30.117491 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c548f8a7-7e12-4b9b-99d5-07d8ea4f5166 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:30.118352 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c548f8a7-7e12-4b9b-99d5-07d8ea4f5166 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:30.119029 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c548f8a7-7e12-4b9b-99d5-07d8ea4f5166 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:30.119955 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c548f8a7-7e12-4b9b-99d5-07d8ea4f5166 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:30.120661 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c548f8a7-7e12-4b9b-99d5-07d8ea4f5166 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:30.121364 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c548f8a7-7e12-4b9b-99d5-07d8ea4f5166 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:30.344500 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-c548f8a7-7e12-4b9b-99d5-07d8ea4f5166 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:30.355626 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-c548f8a7-7e12-4b9b-99d5-07d8ea4f5166 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:30.357510 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-c548f8a7-7e12-4b9b-99d5-07d8ea4f5166 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:30.358926 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-c548f8a7-7e12-4b9b-99d5-07d8ea4f5166 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1729 microversion: 2.20 time: 0.253908 Aug 31 01:28:30.360040 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 337/680] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:28:30 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1729 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:28:31.188706 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-fbee0f4f-2289-401b-98d2-761c9298e44d tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f2d910a2-253e-43ec-9c04-d723f7d4f649"}} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:28:31.191175 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-fbee0f4f-2289-401b-98d2-761c9298e44d tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: f29a15ea-aad6-4491-a2e4-602f9ee66899] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:31.200596 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fbee0f4f-2289-401b-98d2-761c9298e44d tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:31.201327 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fbee0f4f-2289-401b-98d2-761c9298e44d tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:31.206616 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fbee0f4f-2289-401b-98d2-761c9298e44d tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:31.210987 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fbee0f4f-2289-401b-98d2-761c9298e44d tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:31.211921 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fbee0f4f-2289-401b-98d2-761c9298e44d tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:31.214811 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fbee0f4f-2289-401b-98d2-761c9298e44d tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:31.384074 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-6670c5e4-d5fc-44cb-993d-6a63c1f78f7a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:31.385528 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-6670c5e4-d5fc-44cb-993d-6a63c1f78f7a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:31.394785 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6670c5e4-d5fc-44cb-993d-6a63c1f78f7a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:31.396436 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6670c5e4-d5fc-44cb-993d-6a63c1f78f7a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:31.397216 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6670c5e4-d5fc-44cb-993d-6a63c1f78f7a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:31.398228 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6670c5e4-d5fc-44cb-993d-6a63c1f78f7a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:31.398931 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6670c5e4-d5fc-44cb-993d-6a63c1f78f7a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:31.399587 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6670c5e4-d5fc-44cb-993d-6a63c1f78f7a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:31.596983 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-6670c5e4-d5fc-44cb-993d-6a63c1f78f7a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:31.609586 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-6670c5e4-d5fc-44cb-993d-6a63c1f78f7a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:31.611457 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-6670c5e4-d5fc-44cb-993d-6a63c1f78f7a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:31.612961 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-6670c5e4-d5fc-44cb-993d-6a63c1f78f7a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1729 microversion: 2.20 time: 0.234207 Aug 31 01:28:31.614075 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 338/681] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:28:31 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1729 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 01:28:32.528883 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-9dce58a0-d62d-4183-83ce-36962192f2d6 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Action: 'create', calling method: .version_select at 0x7f1fe15f9040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1780112385", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONowCUiWSb/18Yvwyc9Gsy0rDo+MnrbfmT5e4cFgqoArNychqYG6/lt62adBJC31f+AiqCf4VUZMCNsvHrr6EzXOp77eu8JNTJprnOaIfEoTCEQz8VoNfT9nhnRVZQu8A=="}} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:28:32.545874 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.quota [None req-9dce58a0-d62d-4183-83ce-36962192f2d6 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Getting quotas for project 9befc65a9da84a99942b803ac6a15a0b. Resources: {'key_pairs'} {{(pid=121025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 01:28:32.550372 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.quota [None req-9dce58a0-d62d-4183-83ce-36962192f2d6 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Getting quotas for user cb0154f4a3704bd0b746071bdfb90420 and project 9befc65a9da84a99942b803ac6a15a0b. Resources: {'key_pairs'} {{(pid=121025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 01:28:32.637925 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-9dce58a0-d62d-4183-83ce-36962192f2d6 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.112873 Aug 31 01:28:32.638591 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 339/682] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Aug 31 01:28:32 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:28:32.644201 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-333e5728-0bfe-4170-a830-d6b1033c2ce8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:32.646260 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-333e5728-0bfe-4170-a830-d6b1033c2ce8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:32.651968 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-333e5728-0bfe-4170-a830-d6b1033c2ce8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:32.652967 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-333e5728-0bfe-4170-a830-d6b1033c2ce8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:32.653402 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-333e5728-0bfe-4170-a830-d6b1033c2ce8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:32.654091 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-333e5728-0bfe-4170-a830-d6b1033c2ce8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:32.654982 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-333e5728-0bfe-4170-a830-d6b1033c2ce8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:32.654982 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-333e5728-0bfe-4170-a830-d6b1033c2ce8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:32.819493 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-333e5728-0bfe-4170-a830-d6b1033c2ce8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:32.828040 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-333e5728-0bfe-4170-a830-d6b1033c2ce8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:32.829737 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-333e5728-0bfe-4170-a830-d6b1033c2ce8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:32.831470 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-333e5728-0bfe-4170-a830-d6b1033c2ce8 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1729 microversion: 2.20 time: 0.191490 Aug 31 01:28:32.832024 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 340/683] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:28:32 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1729 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:28:32.837164 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-d41d9095-e8af-41b8-944d-94613a0ab01f tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1993387771", "imageRef": "de1ef459-f886-4fce-a8f6-2df2874114a7", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1780112385", "networks": [{"uuid": "7a33e2f8-ef6e-4042-bf72-dbdd2f88e4f3"}]}} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:28:32.922569 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.network.neutron [None req-d41d9095-e8af-41b8-944d-94613a0ab01f tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] validate_networks() for [('7a33e2f8-ef6e-4042-bf72-dbdd2f88e4f3', None, None, None, None, None)] {{(pid=121025) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 01:28:33.327685 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-d41d9095-e8af-41b8-944d-94613a0ab01f tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Flavor limits 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 01:28:33.328263 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-d41d9095-e8af-41b8-944d-94613a0ab01f tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Image limits 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 01:28:33.328866 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-d41d9095-e8af-41b8-944d-94613a0ab01f tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Flavor pref 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 01:28:33.329375 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-d41d9095-e8af-41b8-944d-94613a0ab01f tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Image pref 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 01:28:33.330134 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-d41d9095-e8af-41b8-944d-94613a0ab01f tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 01:28:33.339704 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d41d9095-e8af-41b8-944d-94613a0ab01f tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:33.340356 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d41d9095-e8af-41b8-944d-94613a0ab01f tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:33.340898 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d41d9095-e8af-41b8-944d-94613a0ab01f tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:33.341756 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d41d9095-e8af-41b8-944d-94613a0ab01f tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:33.342289 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d41d9095-e8af-41b8-944d-94613a0ab01f tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:33.342810 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d41d9095-e8af-41b8-944d-94613a0ab01f tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:33.362441 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.quota [None req-d41d9095-e8af-41b8-944d-94613a0ab01f tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Getting quotas for project 9befc65a9da84a99942b803ac6a15a0b. Resources: {'instances', 'cores', 'ram'} {{(pid=121025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 01:28:33.366838 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.quota [None req-d41d9095-e8af-41b8-944d-94613a0ab01f tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Getting quotas for user cb0154f4a3704bd0b746071bdfb90420 and project 9befc65a9da84a99942b803ac6a15a0b. Resources: {'instances', 'cores', 'ram'} {{(pid=121025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 01:28:33.378640 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-d41d9095-e8af-41b8-944d-94613a0ab01f tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Going to run 1 instances... {{(pid=121025) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 01:28:33.381122 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-d41d9095-e8af-41b8-944d-94613a0ab01f tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='de1ef459-f886-4fce-a8f6-2df2874114a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 01:28:33.545563 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-d41d9095-e8af-41b8-944d-94613a0ab01f tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.711995 Aug 31 01:28:33.547949 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 341/684] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 31 01:28:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 01:28:33.562408 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-0fb59397-d7d5-47bc-8c9f-3991cd51a6e6 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:33.565401 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-0fb59397-d7d5-47bc-8c9f-3991cd51a6e6 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:33.659493 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-0fb59397-d7d5-47bc-8c9f-3991cd51a6e6 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:33.668274 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-0fb59397-d7d5-47bc-8c9f-3991cd51a6e6 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1259 microversion: 2.1 time: 0.112775 Aug 31 01:28:33.675381 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 342/685] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:28:33 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1259 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:28:33.854848 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-7910cec0-3699-4089-a883-2e536dcb8580 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:33.855529 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-7910cec0-3699-4089-a883-2e536dcb8580 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:33.862744 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7910cec0-3699-4089-a883-2e536dcb8580 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:33.864787 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7910cec0-3699-4089-a883-2e536dcb8580 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:33.864787 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7910cec0-3699-4089-a883-2e536dcb8580 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:33.864787 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7910cec0-3699-4089-a883-2e536dcb8580 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:33.865091 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7910cec0-3699-4089-a883-2e536dcb8580 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:33.865260 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7910cec0-3699-4089-a883-2e536dcb8580 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:34.020598 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-7910cec0-3699-4089-a883-2e536dcb8580 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:34.029364 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-7910cec0-3699-4089-a883-2e536dcb8580 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:34.030959 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-7910cec0-3699-4089-a883-2e536dcb8580 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:34.032241 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-7910cec0-3699-4089-a883-2e536dcb8580 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1729 microversion: 2.20 time: 0.181375 Aug 31 01:28:34.032931 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 343/686] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:28:33 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 01:28:34.697640 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-779d1ea7-6fd3-4344-ab84-923b42da761f tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:34.698279 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-779d1ea7-6fd3-4344-ab84-923b42da761f tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:34.756036 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-779d1ea7-6fd3-4344-ab84-923b42da761f tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:34.769541 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-779d1ea7-6fd3-4344-ab84-923b42da761f tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1259 microversion: 2.1 time: 0.079381 Aug 31 01:28:34.770137 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 344/687] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:28:34 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1259 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:28:35.055556 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-570d0dc9-45a2-4760-aa05-87baaa3a459d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:35.056175 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-570d0dc9-45a2-4760-aa05-87baaa3a459d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:35.063003 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-570d0dc9-45a2-4760-aa05-87baaa3a459d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:35.063482 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-570d0dc9-45a2-4760-aa05-87baaa3a459d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:35.063909 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-570d0dc9-45a2-4760-aa05-87baaa3a459d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:35.064631 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-570d0dc9-45a2-4760-aa05-87baaa3a459d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:35.065103 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-570d0dc9-45a2-4760-aa05-87baaa3a459d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:35.065660 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-570d0dc9-45a2-4760-aa05-87baaa3a459d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:35.224342 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-570d0dc9-45a2-4760-aa05-87baaa3a459d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:35.236566 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-570d0dc9-45a2-4760-aa05-87baaa3a459d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:35.237278 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-570d0dc9-45a2-4760-aa05-87baaa3a459d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:35.238821 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-570d0dc9-45a2-4760-aa05-87baaa3a459d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1729 microversion: 2.20 time: 0.187009 Aug 31 01:28:35.239687 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 345/688] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:28:35 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1729 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 01:28:35.790494 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-2cea6c70-c0bf-4f54-905e-4516b9950606 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:35.791126 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-2cea6c70-c0bf-4f54-905e-4516b9950606 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:35.797391 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2cea6c70-c0bf-4f54-905e-4516b9950606 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:35.797865 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2cea6c70-c0bf-4f54-905e-4516b9950606 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:35.798289 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2cea6c70-c0bf-4f54-905e-4516b9950606 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:35.798969 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2cea6c70-c0bf-4f54-905e-4516b9950606 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:35.799410 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2cea6c70-c0bf-4f54-905e-4516b9950606 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:35.799823 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2cea6c70-c0bf-4f54-905e-4516b9950606 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:35.862094 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-2cea6c70-c0bf-4f54-905e-4516b9950606 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:35.869759 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-2cea6c70-c0bf-4f54-905e-4516b9950606 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1263 microversion: 2.1 time: 0.083152 Aug 31 01:28:35.870355 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 346/689] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:28:35 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1263 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:28:36.262104 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-6cb1ac8d-78d5-4ff9-8751-9659462f5330 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:36.262738 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-6cb1ac8d-78d5-4ff9-8751-9659462f5330 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:36.269506 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6cb1ac8d-78d5-4ff9-8751-9659462f5330 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:36.269999 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6cb1ac8d-78d5-4ff9-8751-9659462f5330 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:36.270432 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6cb1ac8d-78d5-4ff9-8751-9659462f5330 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:36.271121 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6cb1ac8d-78d5-4ff9-8751-9659462f5330 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:36.271570 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6cb1ac8d-78d5-4ff9-8751-9659462f5330 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:36.271984 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6cb1ac8d-78d5-4ff9-8751-9659462f5330 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:36.402699 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-6cb1ac8d-78d5-4ff9-8751-9659462f5330 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:36.411353 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-6cb1ac8d-78d5-4ff9-8751-9659462f5330 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:36.412794 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-6cb1ac8d-78d5-4ff9-8751-9659462f5330 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:36.413938 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-6cb1ac8d-78d5-4ff9-8751-9659462f5330 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1729 microversion: 2.20 time: 0.155789 Aug 31 01:28:36.414496 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 347/690] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:28:36 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 01:28:36.890228 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-931a853b-2911-4983-96de-ded7cc6174a6 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:36.890836 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-931a853b-2911-4983-96de-ded7cc6174a6 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:36.898112 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-931a853b-2911-4983-96de-ded7cc6174a6 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:36.898595 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-931a853b-2911-4983-96de-ded7cc6174a6 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:36.899355 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-931a853b-2911-4983-96de-ded7cc6174a6 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:36.899712 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-931a853b-2911-4983-96de-ded7cc6174a6 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:36.900165 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-931a853b-2911-4983-96de-ded7cc6174a6 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:36.900589 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-931a853b-2911-4983-96de-ded7cc6174a6 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:36.966049 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-931a853b-2911-4983-96de-ded7cc6174a6 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:36.973823 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-931a853b-2911-4983-96de-ded7cc6174a6 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1255 microversion: 2.1 time: 0.087464 Aug 31 01:28:36.974391 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 348/691] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:28:36 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1255 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:28:37.436565 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-2a58f007-5501-461d-b258-3940e7d80584 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:37.437845 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-2a58f007-5501-461d-b258-3940e7d80584 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:37.439152 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-fbee0f4f-2289-401b-98d2-761c9298e44d tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "POST /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.254521 Aug 31 01:28:37.439754 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 344/692] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 31 01:28:31 2022] POST /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899/os-volume_attachments => generated 194 bytes in 6256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:28:37.444118 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2a58f007-5501-461d-b258-3940e7d80584 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:37.444997 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2a58f007-5501-461d-b258-3940e7d80584 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:37.445190 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2a58f007-5501-461d-b258-3940e7d80584 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:37.445881 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2a58f007-5501-461d-b258-3940e7d80584 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:37.446334 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2a58f007-5501-461d-b258-3940e7d80584 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:37.446754 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2a58f007-5501-461d-b258-3940e7d80584 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:37.580705 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-2a58f007-5501-461d-b258-3940e7d80584 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:37.590518 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-2a58f007-5501-461d-b258-3940e7d80584 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:37.591962 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-2a58f007-5501-461d-b258-3940e7d80584 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:37.593214 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-2a58f007-5501-461d-b258-3940e7d80584 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1729 microversion: 2.20 time: 0.160541 Aug 31 01:28:37.593989 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 349/693] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:28:37 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 01:28:37.997673 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-de800a88-5942-44cd-8b2a-5d539756792f tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:37.998520 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-de800a88-5942-44cd-8b2a-5d539756792f tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:38.012634 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-de800a88-5942-44cd-8b2a-5d539756792f tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:38.013151 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-de800a88-5942-44cd-8b2a-5d539756792f tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:38.013581 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-de800a88-5942-44cd-8b2a-5d539756792f tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:38.014276 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-de800a88-5942-44cd-8b2a-5d539756792f tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:38.014723 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-de800a88-5942-44cd-8b2a-5d539756792f tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:38.015140 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-de800a88-5942-44cd-8b2a-5d539756792f tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:38.030022 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-770be23d-bfa5-49c1-bd42-90057c3543f3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:38.030568 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-770be23d-bfa5-49c1-bd42-90057c3543f3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:38.036344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-770be23d-bfa5-49c1-bd42-90057c3543f3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:38.042297 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-770be23d-bfa5-49c1-bd42-90057c3543f3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:38.042791 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-770be23d-bfa5-49c1-bd42-90057c3543f3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:38.043571 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-770be23d-bfa5-49c1-bd42-90057c3543f3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:38.044023 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-770be23d-bfa5-49c1-bd42-90057c3543f3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:38.044538 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-770be23d-bfa5-49c1-bd42-90057c3543f3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:38.117041 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-de800a88-5942-44cd-8b2a-5d539756792f tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:38.126390 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-de800a88-5942-44cd-8b2a-5d539756792f tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1319 microversion: 2.1 time: 0.133734 Aug 31 01:28:38.140933 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 345/694] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:28:37 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:28:38.155054 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.objects.instance [None req-770be23d-bfa5-49c1-bd42-90057c3543f3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lazy-loading 'services' on Instance uuid 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac {{(pid=121025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:28:38.326637 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-770be23d-bfa5-49c1-bd42-90057c3543f3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac/os-volume_attachments/9d628683-1def-4cc5-91c3-4c028e2fad55" status: 202 len: 0 microversion: 2.1 time: 0.300255 Aug 31 01:28:38.327879 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 350/695] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 31 01:28:38 2022] DELETE /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac/os-volume_attachments/9d628683-1def-4cc5-91c3-4c028e2fad55 => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 01:28:38.336933 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-87bdbba6-e977-4c09-9ed4-ebee0ae992cd tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:38.339466 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-87bdbba6-e977-4c09-9ed4-ebee0ae992cd tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:38.345724 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-87bdbba6-e977-4c09-9ed4-ebee0ae992cd tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:38.346211 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-87bdbba6-e977-4c09-9ed4-ebee0ae992cd tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:38.347141 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-87bdbba6-e977-4c09-9ed4-ebee0ae992cd tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:38.347846 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-87bdbba6-e977-4c09-9ed4-ebee0ae992cd tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:38.348293 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-87bdbba6-e977-4c09-9ed4-ebee0ae992cd tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:38.348715 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-87bdbba6-e977-4c09-9ed4-ebee0ae992cd tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:38.378571 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-87bdbba6-e977-4c09-9ed4-ebee0ae992cd tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046130 Aug 31 01:28:38.379149 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 346/696] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 01:28:38 2022] GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:28:38.618979 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-6c5c09f5-7dd0-42a1-953b-b10eba4173a6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:38.620391 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-6c5c09f5-7dd0-42a1-953b-b10eba4173a6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:38.627962 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6c5c09f5-7dd0-42a1-953b-b10eba4173a6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:38.628506 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6c5c09f5-7dd0-42a1-953b-b10eba4173a6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:38.629278 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6c5c09f5-7dd0-42a1-953b-b10eba4173a6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:38.630298 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6c5c09f5-7dd0-42a1-953b-b10eba4173a6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:38.631304 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6c5c09f5-7dd0-42a1-953b-b10eba4173a6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:38.632495 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6c5c09f5-7dd0-42a1-953b-b10eba4173a6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:38.661687 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:28:38.791833 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-6c5c09f5-7dd0-42a1-953b-b10eba4173a6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:38.801086 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-6c5c09f5-7dd0-42a1-953b-b10eba4173a6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:38.803027 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-6c5c09f5-7dd0-42a1-953b-b10eba4173a6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:38.804401 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-6c5c09f5-7dd0-42a1-953b-b10eba4173a6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1729 microversion: 2.20 time: 0.190931 Aug 31 01:28:38.805005 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 351/697] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:28:38 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1729 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:28:39.151337 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-188bab18-bb31-4a24-a7c3-a9489ec348be tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:39.151337 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-188bab18-bb31-4a24-a7c3-a9489ec348be tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:39.169380 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-188bab18-bb31-4a24-a7c3-a9489ec348be tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:39.171058 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-188bab18-bb31-4a24-a7c3-a9489ec348be tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:39.171058 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-188bab18-bb31-4a24-a7c3-a9489ec348be tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:39.174938 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-188bab18-bb31-4a24-a7c3-a9489ec348be tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:39.175670 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-188bab18-bb31-4a24-a7c3-a9489ec348be tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:39.176355 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-188bab18-bb31-4a24-a7c3-a9489ec348be tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:39.383783 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-188bab18-bb31-4a24-a7c3-a9489ec348be tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:39.386786 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=4,nova_cell1:UPDATE=8 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:28:39.391531 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-875f541a-e5a7-43aa-bd7e-ec573c4b5c43 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:39.394857 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-875f541a-e5a7-43aa-bd7e-ec573c4b5c43 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:39.396696 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-188bab18-bb31-4a24-a7c3-a9489ec348be tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1359 microversion: 2.1 time: 0.251972 Aug 31 01:28:39.397865 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 347/698] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:28:39 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1359 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:28:39.413136 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-875f541a-e5a7-43aa-bd7e-ec573c4b5c43 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:39.414512 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-875f541a-e5a7-43aa-bd7e-ec573c4b5c43 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:39.415568 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-875f541a-e5a7-43aa-bd7e-ec573c4b5c43 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:39.417630 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-875f541a-e5a7-43aa-bd7e-ec573c4b5c43 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:39.418720 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-875f541a-e5a7-43aa-bd7e-ec573c4b5c43 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:39.419537 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-875f541a-e5a7-43aa-bd7e-ec573c4b5c43 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:39.477124 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-875f541a-e5a7-43aa-bd7e-ec573c4b5c43 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089569 Aug 31 01:28:39.478415 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 352/699] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 01:28:39 2022] GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:28:39.832387 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-c63e2c79-f471-4b5c-addc-c385e8704bd5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:39.833407 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-c63e2c79-f471-4b5c-addc-c385e8704bd5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:39.839931 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c63e2c79-f471-4b5c-addc-c385e8704bd5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:39.840469 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c63e2c79-f471-4b5c-addc-c385e8704bd5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:39.840932 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c63e2c79-f471-4b5c-addc-c385e8704bd5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:39.841710 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c63e2c79-f471-4b5c-addc-c385e8704bd5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:39.842534 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c63e2c79-f471-4b5c-addc-c385e8704bd5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:39.843101 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c63e2c79-f471-4b5c-addc-c385e8704bd5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:40.015780 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-c63e2c79-f471-4b5c-addc-c385e8704bd5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:40.025503 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-c63e2c79-f471-4b5c-addc-c385e8704bd5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:40.027033 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-c63e2c79-f471-4b5c-addc-c385e8704bd5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:40.028204 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-c63e2c79-f471-4b5c-addc-c385e8704bd5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1729 microversion: 2.20 time: 0.201817 Aug 31 01:28:40.028785 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 348/700] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:28:39 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1729 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:28:40.419510 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-f23bca3d-c90f-4d9d-a94b-5de1b30b1f34 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:40.420109 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-f23bca3d-c90f-4d9d-a94b-5de1b30b1f34 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:40.426706 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f23bca3d-c90f-4d9d-a94b-5de1b30b1f34 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:40.427186 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f23bca3d-c90f-4d9d-a94b-5de1b30b1f34 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:40.427619 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f23bca3d-c90f-4d9d-a94b-5de1b30b1f34 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:40.428307 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f23bca3d-c90f-4d9d-a94b-5de1b30b1f34 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:40.428778 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f23bca3d-c90f-4d9d-a94b-5de1b30b1f34 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:40.429202 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f23bca3d-c90f-4d9d-a94b-5de1b30b1f34 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:40.490677 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-5d090a61-801a-4e33-8ac8-fd6325da73c9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:40.493607 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-5d090a61-801a-4e33-8ac8-fd6325da73c9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:40.507458 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5d090a61-801a-4e33-8ac8-fd6325da73c9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:40.510477 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5d090a61-801a-4e33-8ac8-fd6325da73c9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:40.511088 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5d090a61-801a-4e33-8ac8-fd6325da73c9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:40.511983 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5d090a61-801a-4e33-8ac8-fd6325da73c9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:40.513203 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5d090a61-801a-4e33-8ac8-fd6325da73c9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:40.515329 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5d090a61-801a-4e33-8ac8-fd6325da73c9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:40.567926 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-5d090a61-801a-4e33-8ac8-fd6325da73c9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081580 Aug 31 01:28:40.568937 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 349/701] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 01:28:40 2022] GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:28:40.623491 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-f23bca3d-c90f-4d9d-a94b-5de1b30b1f34 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:40.633004 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-f23bca3d-c90f-4d9d-a94b-5de1b30b1f34 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1359 microversion: 2.1 time: 0.216245 Aug 31 01:28:40.633004 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 353/702] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:28:40 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1359 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:28:40.656293 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [req-8d773f94-7209-49c6-b705-e6ef2e387fce req-1f4f2ee9-37b1-41f1-bf4c-9b249a06a323 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7311a59-7d10-4edb-be41-f6872e563e09", "name": "network-vif-plugged", "status": "completed", "tag": "1302084d-99f4-4cd1-8b6d-4a829a883993"}]} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:28:40.669446 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-8d773f94-7209-49c6-b705-e6ef2e387fce req-1f4f2ee9-37b1-41f1-bf4c-9b249a06a323 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:40.669986 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-8d773f94-7209-49c6-b705-e6ef2e387fce req-1f4f2ee9-37b1-41f1-bf4c-9b249a06a323 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:40.670356 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-8d773f94-7209-49c6-b705-e6ef2e387fce req-1f4f2ee9-37b1-41f1-bf4c-9b249a06a323 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:40.683703 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.compute.server_external_events [req-8d773f94-7209-49c6-b705-e6ef2e387fce req-1f4f2ee9-37b1-41f1-bf4c-9b249a06a323 service nova] Creating event network-vif-plugged:1302084d-99f4-4cd1-8b6d-4a829a883993 for instance b7311a59-7d10-4edb-be41-f6872e563e09 on hv-cinder-85528 Aug 31 01:28:40.688620 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [req-8d773f94-7209-49c6-b705-e6ef2e387fce req-1f4f2ee9-37b1-41f1-bf4c-9b249a06a323 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041720 Aug 31 01:28:40.689289 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 350/703] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:28:41.054082 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-f76e6904-63d0-4089-8598-34954c265743 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:41.055806 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-f76e6904-63d0-4089-8598-34954c265743 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:41.064113 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f76e6904-63d0-4089-8598-34954c265743 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:41.065281 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f76e6904-63d0-4089-8598-34954c265743 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:41.066384 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f76e6904-63d0-4089-8598-34954c265743 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:41.067207 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f76e6904-63d0-4089-8598-34954c265743 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:41.067740 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f76e6904-63d0-4089-8598-34954c265743 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:41.068233 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f76e6904-63d0-4089-8598-34954c265743 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:41.226078 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-f76e6904-63d0-4089-8598-34954c265743 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:41.234745 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-f76e6904-63d0-4089-8598-34954c265743 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:41.236273 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-f76e6904-63d0-4089-8598-34954c265743 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:41.238035 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-f76e6904-63d0-4089-8598-34954c265743 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1729 microversion: 2.20 time: 0.189661 Aug 31 01:28:41.238633 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 354/704] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:28:41 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1729 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:28:41.581219 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-44f07907-3ab9-4051-8552-352b011a9956 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:41.583410 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-44f07907-3ab9-4051-8552-352b011a9956 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:41.589841 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-44f07907-3ab9-4051-8552-352b011a9956 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:41.590359 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-44f07907-3ab9-4051-8552-352b011a9956 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:41.590797 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-44f07907-3ab9-4051-8552-352b011a9956 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:41.591507 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-44f07907-3ab9-4051-8552-352b011a9956 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:41.591960 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-44f07907-3ab9-4051-8552-352b011a9956 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:41.592382 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-44f07907-3ab9-4051-8552-352b011a9956 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:41.622527 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-44f07907-3ab9-4051-8552-352b011a9956 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046506 Aug 31 01:28:41.623082 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 351/705] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 01:28:41 2022] GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:28:41.656908 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-2a9acb65-1f74-4346-a3ea-acbf2f83558c tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:41.658693 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-2a9acb65-1f74-4346-a3ea-acbf2f83558c tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:41.667338 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2a9acb65-1f74-4346-a3ea-acbf2f83558c tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:41.668171 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2a9acb65-1f74-4346-a3ea-acbf2f83558c tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:41.669125 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2a9acb65-1f74-4346-a3ea-acbf2f83558c tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:41.670222 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2a9acb65-1f74-4346-a3ea-acbf2f83558c tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:41.670773 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2a9acb65-1f74-4346-a3ea-acbf2f83558c tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:41.671285 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2a9acb65-1f74-4346-a3ea-acbf2f83558c tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:41.822511 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-2a9acb65-1f74-4346-a3ea-acbf2f83558c tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:41.830648 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-2a9acb65-1f74-4346-a3ea-acbf2f83558c tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1359 microversion: 2.1 time: 0.179513 Aug 31 01:28:41.831782 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 355/706] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:28:41 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:28:42.261356 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-e95b4dc3-32a8-414e-9591-e8f2a33393f6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:42.262453 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-e95b4dc3-32a8-414e-9591-e8f2a33393f6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:42.269077 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e95b4dc3-32a8-414e-9591-e8f2a33393f6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:42.269658 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e95b4dc3-32a8-414e-9591-e8f2a33393f6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:42.270176 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e95b4dc3-32a8-414e-9591-e8f2a33393f6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:42.271126 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e95b4dc3-32a8-414e-9591-e8f2a33393f6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:42.271828 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e95b4dc3-32a8-414e-9591-e8f2a33393f6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:42.272487 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e95b4dc3-32a8-414e-9591-e8f2a33393f6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:42.405733 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-e95b4dc3-32a8-414e-9591-e8f2a33393f6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:42.415218 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-e95b4dc3-32a8-414e-9591-e8f2a33393f6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:42.416981 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-e95b4dc3-32a8-414e-9591-e8f2a33393f6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:42.418531 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-e95b4dc3-32a8-414e-9591-e8f2a33393f6 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1729 microversion: 2.20 time: 0.161225 Aug 31 01:28:42.419615 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 352/707] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:28:42 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:28:42.635413 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-708f04bd-8133-4924-a4b0-bf3524faa6ea tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:42.637765 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-708f04bd-8133-4924-a4b0-bf3524faa6ea tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:42.644091 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-708f04bd-8133-4924-a4b0-bf3524faa6ea tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:42.644650 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-708f04bd-8133-4924-a4b0-bf3524faa6ea tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:42.645106 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-708f04bd-8133-4924-a4b0-bf3524faa6ea tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:42.645800 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-708f04bd-8133-4924-a4b0-bf3524faa6ea tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:42.646245 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-708f04bd-8133-4924-a4b0-bf3524faa6ea tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:42.646683 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-708f04bd-8133-4924-a4b0-bf3524faa6ea tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:42.676384 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-708f04bd-8133-4924-a4b0-bf3524faa6ea tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044911 Aug 31 01:28:42.677111 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 356/708] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 01:28:42 2022] GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:28:42.851490 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-0ba486eb-e096-4bb9-956e-d5533e89c87a tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:42.852133 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-0ba486eb-e096-4bb9-956e-d5533e89c87a tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:42.858823 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0ba486eb-e096-4bb9-956e-d5533e89c87a tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:42.859296 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0ba486eb-e096-4bb9-956e-d5533e89c87a tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:42.859751 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0ba486eb-e096-4bb9-956e-d5533e89c87a tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:42.860437 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0ba486eb-e096-4bb9-956e-d5533e89c87a tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:42.860919 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0ba486eb-e096-4bb9-956e-d5533e89c87a tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:42.861333 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0ba486eb-e096-4bb9-956e-d5533e89c87a tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:43.004197 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-0ba486eb-e096-4bb9-956e-d5533e89c87a tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:43.011872 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-0ba486eb-e096-4bb9-956e-d5533e89c87a tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1359 microversion: 2.1 time: 0.164268 Aug 31 01:28:43.012529 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 353/709] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:28:42 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:28:43.445535 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-9c5d15c2-88cb-467a-b880-93745216f74b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:43.446237 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-9c5d15c2-88cb-467a-b880-93745216f74b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:43.448175 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell0:SELECT=2 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:28:43.448928 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:28:43.453689 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9c5d15c2-88cb-467a-b880-93745216f74b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:43.454177 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9c5d15c2-88cb-467a-b880-93745216f74b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:43.454886 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9c5d15c2-88cb-467a-b880-93745216f74b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:43.455784 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9c5d15c2-88cb-467a-b880-93745216f74b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:43.456239 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9c5d15c2-88cb-467a-b880-93745216f74b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:43.456663 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9c5d15c2-88cb-467a-b880-93745216f74b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:43.594421 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-9c5d15c2-88cb-467a-b880-93745216f74b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:43.604293 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-9c5d15c2-88cb-467a-b880-93745216f74b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:43.606342 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-9c5d15c2-88cb-467a-b880-93745216f74b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:43.608128 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-9c5d15c2-88cb-467a-b880-93745216f74b tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1729 microversion: 2.20 time: 0.167841 Aug 31 01:28:43.609994 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 357/710] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:28:43 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:28:43.688683 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-a7e3eafc-56e9-4a56-b2b9-d44bd3fda2b7 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:43.691543 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-a7e3eafc-56e9-4a56-b2b9-d44bd3fda2b7 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:43.697697 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a7e3eafc-56e9-4a56-b2b9-d44bd3fda2b7 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:43.698107 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a7e3eafc-56e9-4a56-b2b9-d44bd3fda2b7 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:43.698541 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a7e3eafc-56e9-4a56-b2b9-d44bd3fda2b7 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:43.699233 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a7e3eafc-56e9-4a56-b2b9-d44bd3fda2b7 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:43.699682 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a7e3eafc-56e9-4a56-b2b9-d44bd3fda2b7 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:43.700102 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a7e3eafc-56e9-4a56-b2b9-d44bd3fda2b7 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:43.733024 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-a7e3eafc-56e9-4a56-b2b9-d44bd3fda2b7 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048270 Aug 31 01:28:43.733716 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 354/711] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 01:28:43 2022] GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:28:44.035782 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-878acdce-8168-4e54-a4e3-06639047bf44 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:44.036364 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-878acdce-8168-4e54-a4e3-06639047bf44 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:44.043396 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-878acdce-8168-4e54-a4e3-06639047bf44 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:44.044266 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-878acdce-8168-4e54-a4e3-06639047bf44 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:44.044968 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-878acdce-8168-4e54-a4e3-06639047bf44 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:44.045925 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-878acdce-8168-4e54-a4e3-06639047bf44 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:44.046617 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-878acdce-8168-4e54-a4e3-06639047bf44 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:44.047426 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-878acdce-8168-4e54-a4e3-06639047bf44 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:44.190802 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-878acdce-8168-4e54-a4e3-06639047bf44 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:44.198335 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-878acdce-8168-4e54-a4e3-06639047bf44 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1359 microversion: 2.1 time: 0.168764 Aug 31 01:28:44.198896 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 358/712] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:28:44 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:28:44.632061 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-a7323027-2b93-4823-8bf5-817549a2f0eb tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:44.632629 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-a7323027-2b93-4823-8bf5-817549a2f0eb tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:44.639041 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a7323027-2b93-4823-8bf5-817549a2f0eb tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:44.639523 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a7323027-2b93-4823-8bf5-817549a2f0eb tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:44.639960 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a7323027-2b93-4823-8bf5-817549a2f0eb tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:44.640646 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a7323027-2b93-4823-8bf5-817549a2f0eb tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:44.641123 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a7323027-2b93-4823-8bf5-817549a2f0eb tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:44.641544 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a7323027-2b93-4823-8bf5-817549a2f0eb tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:44.746446 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-37a66772-507d-4ada-a55d-29bf3c608c75 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:44.748817 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-37a66772-507d-4ada-a55d-29bf3c608c75 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:44.755466 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-37a66772-507d-4ada-a55d-29bf3c608c75 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:44.755955 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-37a66772-507d-4ada-a55d-29bf3c608c75 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:44.757023 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-37a66772-507d-4ada-a55d-29bf3c608c75 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:44.757172 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-37a66772-507d-4ada-a55d-29bf3c608c75 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:44.757583 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-37a66772-507d-4ada-a55d-29bf3c608c75 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:44.758033 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-37a66772-507d-4ada-a55d-29bf3c608c75 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:44.778171 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell0:SELECT=14 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:28:44.807523 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-37a66772-507d-4ada-a55d-29bf3c608c75 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063502 Aug 31 01:28:44.807523 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 359/713] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 01:28:44 2022] GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:28:44.811362 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-a7323027-2b93-4823-8bf5-817549a2f0eb tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:44.820602 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-a7323027-2b93-4823-8bf5-817549a2f0eb tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:44.826265 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-a7323027-2b93-4823-8bf5-817549a2f0eb tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:44.826265 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-a7323027-2b93-4823-8bf5-817549a2f0eb tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1729 microversion: 2.20 time: 0.195355 Aug 31 01:28:44.826265 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 355/714] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:28:44 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1729 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:28:45.219052 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-165ca1bb-bc08-420a-ab98-02a87956368e tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:45.219679 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-165ca1bb-bc08-420a-ab98-02a87956368e tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:45.226468 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-165ca1bb-bc08-420a-ab98-02a87956368e tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:45.226948 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-165ca1bb-bc08-420a-ab98-02a87956368e tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:45.227382 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-165ca1bb-bc08-420a-ab98-02a87956368e tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:45.228070 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-165ca1bb-bc08-420a-ab98-02a87956368e tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:45.228525 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-165ca1bb-bc08-420a-ab98-02a87956368e tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:45.228978 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-165ca1bb-bc08-420a-ab98-02a87956368e tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:45.368152 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-165ca1bb-bc08-420a-ab98-02a87956368e tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:45.376398 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-165ca1bb-bc08-420a-ab98-02a87956368e tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1359 microversion: 2.1 time: 0.161144 Aug 31 01:28:45.377135 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 360/715] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:28:45 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:28:45.819500 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-b16cefce-a9c5-4835-8e99-f6595831d37f tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:45.820155 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-b16cefce-a9c5-4835-8e99-f6595831d37f tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:45.827452 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b16cefce-a9c5-4835-8e99-f6595831d37f tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:45.827927 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b16cefce-a9c5-4835-8e99-f6595831d37f tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:45.828352 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b16cefce-a9c5-4835-8e99-f6595831d37f tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:45.829073 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b16cefce-a9c5-4835-8e99-f6595831d37f tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:45.829517 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b16cefce-a9c5-4835-8e99-f6595831d37f tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:45.830185 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b16cefce-a9c5-4835-8e99-f6595831d37f tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:45.850539 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-f8c3ee35-a347-4700-bc9f-e99d050dcb4d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:45.851495 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-f8c3ee35-a347-4700-bc9f-e99d050dcb4d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:45.861559 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f8c3ee35-a347-4700-bc9f-e99d050dcb4d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:45.863839 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f8c3ee35-a347-4700-bc9f-e99d050dcb4d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:45.864630 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f8c3ee35-a347-4700-bc9f-e99d050dcb4d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:45.866266 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f8c3ee35-a347-4700-bc9f-e99d050dcb4d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:45.867112 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f8c3ee35-a347-4700-bc9f-e99d050dcb4d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:45.867829 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f8c3ee35-a347-4700-bc9f-e99d050dcb4d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:45.878331 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-b16cefce-a9c5-4835-8e99-f6595831d37f tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064172 Aug 31 01:28:45.879799 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 356/716] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 01:28:45 2022] GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:28:46.039731 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-f8c3ee35-a347-4700-bc9f-e99d050dcb4d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:46.047882 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-f8c3ee35-a347-4700-bc9f-e99d050dcb4d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:46.049583 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-f8c3ee35-a347-4700-bc9f-e99d050dcb4d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:46.051214 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-f8c3ee35-a347-4700-bc9f-e99d050dcb4d tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1729 microversion: 2.20 time: 0.207348 Aug 31 01:28:46.052115 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 361/717] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:28:45 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1729 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:28:46.398061 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-d381025c-e852-4084-8441-4143eec07216 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:46.398817 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-d381025c-e852-4084-8441-4143eec07216 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:46.404879 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d381025c-e852-4084-8441-4143eec07216 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:46.405360 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d381025c-e852-4084-8441-4143eec07216 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:46.405789 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d381025c-e852-4084-8441-4143eec07216 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:46.406474 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d381025c-e852-4084-8441-4143eec07216 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:46.406922 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d381025c-e852-4084-8441-4143eec07216 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:46.407340 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d381025c-e852-4084-8441-4143eec07216 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:46.557760 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-d381025c-e852-4084-8441-4143eec07216 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:46.566572 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-d381025c-e852-4084-8441-4143eec07216 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1359 microversion: 2.1 time: 0.172611 Aug 31 01:28:46.567156 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 357/718] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:28:46 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:28:46.893056 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-902ff905-85db-4434-aa56-e82cf8264670 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:46.897837 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-902ff905-85db-4434-aa56-e82cf8264670 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:46.904122 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-902ff905-85db-4434-aa56-e82cf8264670 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:46.904617 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-902ff905-85db-4434-aa56-e82cf8264670 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:46.905077 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-902ff905-85db-4434-aa56-e82cf8264670 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:46.905808 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-902ff905-85db-4434-aa56-e82cf8264670 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:46.906260 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-902ff905-85db-4434-aa56-e82cf8264670 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:46.906681 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-902ff905-85db-4434-aa56-e82cf8264670 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:46.936963 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-902ff905-85db-4434-aa56-e82cf8264670 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049689 Aug 31 01:28:46.937538 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 362/719] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 01:28:46 2022] GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:28:47.074164 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-28bd8025-db85-442d-a477-31006d6d5e43 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:47.074752 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-28bd8025-db85-442d-a477-31006d6d5e43 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:47.077185 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_api:SELECT=46 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:28:47.082217 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-28bd8025-db85-442d-a477-31006d6d5e43 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:47.091121 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-28bd8025-db85-442d-a477-31006d6d5e43 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:47.091121 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-28bd8025-db85-442d-a477-31006d6d5e43 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:47.091121 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-28bd8025-db85-442d-a477-31006d6d5e43 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:47.091121 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-28bd8025-db85-442d-a477-31006d6d5e43 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:47.091621 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-28bd8025-db85-442d-a477-31006d6d5e43 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:47.221604 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-28bd8025-db85-442d-a477-31006d6d5e43 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:47.225280 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-28bd8025-db85-442d-a477-31006d6d5e43 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:47.226695 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-28bd8025-db85-442d-a477-31006d6d5e43 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:47.227853 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-28bd8025-db85-442d-a477-31006d6d5e43 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1729 microversion: 2.20 time: 0.157561 Aug 31 01:28:47.228389 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 358/720] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:28:47 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:28:47.589416 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-67c5c75e-0a30-4987-983e-8a00e546416c tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:47.590021 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-67c5c75e-0a30-4987-983e-8a00e546416c tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:47.595877 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-67c5c75e-0a30-4987-983e-8a00e546416c tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:47.596358 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-67c5c75e-0a30-4987-983e-8a00e546416c tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:47.596828 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-67c5c75e-0a30-4987-983e-8a00e546416c tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:47.598094 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-67c5c75e-0a30-4987-983e-8a00e546416c tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:47.598540 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-67c5c75e-0a30-4987-983e-8a00e546416c tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:47.598959 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-67c5c75e-0a30-4987-983e-8a00e546416c tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:47.730032 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-67c5c75e-0a30-4987-983e-8a00e546416c tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:47.737887 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-67c5c75e-0a30-4987-983e-8a00e546416c tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1359 microversion: 2.1 time: 0.152293 Aug 31 01:28:47.738462 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 363/721] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:28:47 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:28:47.949793 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-a56c0cb1-a474-4e80-8f4d-e193b5be1c70 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:47.952052 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-a56c0cb1-a474-4e80-8f4d-e193b5be1c70 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:47.958788 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a56c0cb1-a474-4e80-8f4d-e193b5be1c70 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:47.959268 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a56c0cb1-a474-4e80-8f4d-e193b5be1c70 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:47.959705 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a56c0cb1-a474-4e80-8f4d-e193b5be1c70 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:47.960394 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a56c0cb1-a474-4e80-8f4d-e193b5be1c70 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:47.960889 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a56c0cb1-a474-4e80-8f4d-e193b5be1c70 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:47.961311 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a56c0cb1-a474-4e80-8f4d-e193b5be1c70 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:47.990557 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-a56c0cb1-a474-4e80-8f4d-e193b5be1c70 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044657 Aug 31 01:28:47.991361 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 359/722] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 01:28:47 2022] GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:28:48.250934 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-934f27df-cd90-4af4-9f8b-63ce7428b0e3 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:48.251548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-934f27df-cd90-4af4-9f8b-63ce7428b0e3 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:48.258793 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-934f27df-cd90-4af4-9f8b-63ce7428b0e3 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:48.262028 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-934f27df-cd90-4af4-9f8b-63ce7428b0e3 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:48.262028 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-934f27df-cd90-4af4-9f8b-63ce7428b0e3 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:48.262028 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-934f27df-cd90-4af4-9f8b-63ce7428b0e3 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:48.262028 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-934f27df-cd90-4af4-9f8b-63ce7428b0e3 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:48.262401 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-934f27df-cd90-4af4-9f8b-63ce7428b0e3 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:48.470500 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-934f27df-cd90-4af4-9f8b-63ce7428b0e3 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:48.483948 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-934f27df-cd90-4af4-9f8b-63ce7428b0e3 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:48.486802 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-934f27df-cd90-4af4-9f8b-63ce7428b0e3 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:48.488223 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-934f27df-cd90-4af4-9f8b-63ce7428b0e3 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1729 microversion: 2.20 time: 0.241142 Aug 31 01:28:48.489295 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 364/723] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:28:48 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1729 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:28:48.540475 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [req-06d2af97-4a75-4ad3-b364-9d176705a099 req-f1a06acf-7507-4468-b4af-b1c9df57806c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa12f850-924b-4bc9-8f32-c3f25e4a4d7d", "tag": "9a52ea97-a4a8-4c98-835c-b0b492daa956"}]} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:28:48.550540 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-06d2af97-4a75-4ad3-b364-9d176705a099 req-f1a06acf-7507-4468-b4af-b1c9df57806c service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:48.551016 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-06d2af97-4a75-4ad3-b364-9d176705a099 req-f1a06acf-7507-4468-b4af-b1c9df57806c service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:48.551447 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-06d2af97-4a75-4ad3-b364-9d176705a099 req-f1a06acf-7507-4468-b4af-b1c9df57806c service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:48.584108 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.compute.server_external_events [req-06d2af97-4a75-4ad3-b364-9d176705a099 req-f1a06acf-7507-4468-b4af-b1c9df57806c service nova] Creating event network-changed:9a52ea97-a4a8-4c98-835c-b0b492daa956 for instance aa12f850-924b-4bc9-8f32-c3f25e4a4d7d on hv-cinder-85528 Aug 31 01:28:48.590450 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [req-06d2af97-4a75-4ad3-b364-9d176705a099 req-f1a06acf-7507-4468-b4af-b1c9df57806c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137288 Aug 31 01:28:48.592019 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 360/724] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:28:48.758841 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-d15537cb-b90e-4004-a153-3093fd9da4dc tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:48.759658 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-d15537cb-b90e-4004-a153-3093fd9da4dc tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:48.766089 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d15537cb-b90e-4004-a153-3093fd9da4dc tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:48.766572 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d15537cb-b90e-4004-a153-3093fd9da4dc tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:48.767010 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d15537cb-b90e-4004-a153-3093fd9da4dc tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:48.767718 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d15537cb-b90e-4004-a153-3093fd9da4dc tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:48.768145 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d15537cb-b90e-4004-a153-3093fd9da4dc tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:48.768566 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d15537cb-b90e-4004-a153-3093fd9da4dc tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:48.917847 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-d15537cb-b90e-4004-a153-3093fd9da4dc tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:48.925735 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-d15537cb-b90e-4004-a153-3093fd9da4dc tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1359 microversion: 2.1 time: 0.170711 Aug 31 01:28:48.926309 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 365/725] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:28:48 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:28:49.004142 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-7ab2e180-c42c-4894-8ed2-6d2f853c3430 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:49.006376 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-7ab2e180-c42c-4894-8ed2-6d2f853c3430 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:49.012709 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7ab2e180-c42c-4894-8ed2-6d2f853c3430 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:49.013214 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7ab2e180-c42c-4894-8ed2-6d2f853c3430 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:49.013642 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7ab2e180-c42c-4894-8ed2-6d2f853c3430 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:49.014322 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7ab2e180-c42c-4894-8ed2-6d2f853c3430 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:49.014769 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7ab2e180-c42c-4894-8ed2-6d2f853c3430 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:49.015183 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7ab2e180-c42c-4894-8ed2-6d2f853c3430 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:49.043953 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-7ab2e180-c42c-4894-8ed2-6d2f853c3430 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044804 Aug 31 01:28:49.044487 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 361/726] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 01:28:48 2022] GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:28:49.477548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-c10403b7-93e4-4dab-a3a5-edabafb44b3a tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:49.479754 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-c10403b7-93e4-4dab-a3a5-edabafb44b3a tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: f29a15ea-aad6-4491-a2e4-602f9ee66899] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:49.486381 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c10403b7-93e4-4dab-a3a5-edabafb44b3a tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:49.486863 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c10403b7-93e4-4dab-a3a5-edabafb44b3a tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:49.487314 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c10403b7-93e4-4dab-a3a5-edabafb44b3a tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:49.488562 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c10403b7-93e4-4dab-a3a5-edabafb44b3a tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:49.489050 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c10403b7-93e4-4dab-a3a5-edabafb44b3a tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:49.489474 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c10403b7-93e4-4dab-a3a5-edabafb44b3a tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:49.511577 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-91b34c1f-2606-4536-bacf-361fffdf12bf tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:49.512291 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-91b34c1f-2606-4536-bacf-361fffdf12bf tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:49.518746 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-91b34c1f-2606-4536-bacf-361fffdf12bf tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:49.518949 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-c10403b7-93e4-4dab-a3a5-edabafb44b3a tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045302 Aug 31 01:28:49.519354 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-91b34c1f-2606-4536-bacf-361fffdf12bf tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:49.519748 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 366/727] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 01:28:49 2022] GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:28:49.519935 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-91b34c1f-2606-4536-bacf-361fffdf12bf tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:49.520690 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-91b34c1f-2606-4536-bacf-361fffdf12bf tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:49.521244 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-91b34c1f-2606-4536-bacf-361fffdf12bf tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:49.521728 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-91b34c1f-2606-4536-bacf-361fffdf12bf tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:49.529834 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-3b9ac1f8-3030-4ede-a5fd-9e9e5f5ef5d4 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:49.530321 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-3b9ac1f8-3030-4ede-a5fd-9e9e5f5ef5d4 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: f29a15ea-aad6-4491-a2e4-602f9ee66899] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:49.536757 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3b9ac1f8-3030-4ede-a5fd-9e9e5f5ef5d4 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:49.537266 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3b9ac1f8-3030-4ede-a5fd-9e9e5f5ef5d4 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:49.537702 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3b9ac1f8-3030-4ede-a5fd-9e9e5f5ef5d4 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:49.538392 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3b9ac1f8-3030-4ede-a5fd-9e9e5f5ef5d4 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:49.538848 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3b9ac1f8-3030-4ede-a5fd-9e9e5f5ef5d4 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:49.539271 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3b9ac1f8-3030-4ede-a5fd-9e9e5f5ef5d4 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:49.569336 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-3b9ac1f8-3030-4ede-a5fd-9e9e5f5ef5d4 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899/os-volume_attachments/f2d910a2-253e-43ec-9c04-d723f7d4f649" status: 200 len: 194 microversion: 2.1 time: 0.043202 Aug 31 01:28:49.570110 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 367/728] 10.222.0.20 () {58 vars in 1413 bytes} [Wed Aug 31 01:28:49 2022] GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899/os-volume_attachments/f2d910a2-253e-43ec-9c04-d723f7d4f649 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:28:49.658339 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-91b34c1f-2606-4536-bacf-361fffdf12bf tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:49.670673 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-91b34c1f-2606-4536-bacf-361fffdf12bf tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:49.672326 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-91b34c1f-2606-4536-bacf-361fffdf12bf tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:49.674977 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-91b34c1f-2606-4536-bacf-361fffdf12bf tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1729 microversion: 2.20 time: 0.167556 Aug 31 01:28:49.676444 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 362/729] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:28:49 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 01:28:49.949821 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-d663ecd2-e762-4f40-8d44-7c48cc3a1a18 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:49.950625 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-d663ecd2-e762-4f40-8d44-7c48cc3a1a18 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:49.957515 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d663ecd2-e762-4f40-8d44-7c48cc3a1a18 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:49.957990 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d663ecd2-e762-4f40-8d44-7c48cc3a1a18 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:49.958885 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d663ecd2-e762-4f40-8d44-7c48cc3a1a18 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:49.959242 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d663ecd2-e762-4f40-8d44-7c48cc3a1a18 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:49.959701 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d663ecd2-e762-4f40-8d44-7c48cc3a1a18 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:49.960143 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d663ecd2-e762-4f40-8d44-7c48cc3a1a18 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:49.964713 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell1:SELECT=100 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:28:50.055459 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-97efcff8-7868-492b-97e3-52c7e967e5a3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:50.058412 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-97efcff8-7868-492b-97e3-52c7e967e5a3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:50.064385 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-97efcff8-7868-492b-97e3-52c7e967e5a3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:50.064978 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-97efcff8-7868-492b-97e3-52c7e967e5a3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:50.065482 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-97efcff8-7868-492b-97e3-52c7e967e5a3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:50.066271 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-97efcff8-7868-492b-97e3-52c7e967e5a3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:50.066785 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-97efcff8-7868-492b-97e3-52c7e967e5a3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:50.067270 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-97efcff8-7868-492b-97e3-52c7e967e5a3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:50.090005 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-d663ecd2-e762-4f40-8d44-7c48cc3a1a18 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:50.098660 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-d663ecd2-e762-4f40-8d44-7c48cc3a1a18 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1359 microversion: 2.1 time: 0.152726 Aug 31 01:28:50.099270 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-97efcff8-7868-492b-97e3-52c7e967e5a3 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047738 Aug 31 01:28:50.099432 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 368/730] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:28:49 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:28:50.099829 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 363/731] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 01:28:50 2022] GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:28:50.700688 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-66ac8bda-fe0f-4d1a-9bdf-e362ea07b087 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:50.701341 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-66ac8bda-fe0f-4d1a-9bdf-e362ea07b087 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:50.708502 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-66ac8bda-fe0f-4d1a-9bdf-e362ea07b087 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:50.709045 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-66ac8bda-fe0f-4d1a-9bdf-e362ea07b087 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:50.709481 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-66ac8bda-fe0f-4d1a-9bdf-e362ea07b087 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:50.710214 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-66ac8bda-fe0f-4d1a-9bdf-e362ea07b087 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:50.710667 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-66ac8bda-fe0f-4d1a-9bdf-e362ea07b087 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:50.711154 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-66ac8bda-fe0f-4d1a-9bdf-e362ea07b087 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:50.848529 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-66ac8bda-fe0f-4d1a-9bdf-e362ea07b087 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:50.861357 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-66ac8bda-fe0f-4d1a-9bdf-e362ea07b087 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:50.863507 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-66ac8bda-fe0f-4d1a-9bdf-e362ea07b087 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:50.864979 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-66ac8bda-fe0f-4d1a-9bdf-e362ea07b087 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1729 microversion: 2.20 time: 0.168020 Aug 31 01:28:50.865669 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 369/732] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:28:50 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:28:51.111706 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-dad4be09-fb98-45ee-b4f8-42c740ec8d7d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:51.114600 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-dad4be09-fb98-45ee-b4f8-42c740ec8d7d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:51.119108 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-d6130251-7113-43fa-b7b8-205f043f99af tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:51.119713 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-d6130251-7113-43fa-b7b8-205f043f99af tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:51.121145 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-dad4be09-fb98-45ee-b4f8-42c740ec8d7d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:51.121620 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-dad4be09-fb98-45ee-b4f8-42c740ec8d7d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:51.122296 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-dad4be09-fb98-45ee-b4f8-42c740ec8d7d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:51.126207 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d6130251-7113-43fa-b7b8-205f043f99af tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:51.126914 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d6130251-7113-43fa-b7b8-205f043f99af tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:51.127498 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d6130251-7113-43fa-b7b8-205f043f99af tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:51.128377 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d6130251-7113-43fa-b7b8-205f043f99af tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:51.128888 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d6130251-7113-43fa-b7b8-205f043f99af tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:51.129311 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d6130251-7113-43fa-b7b8-205f043f99af tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:51.132092 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-dad4be09-fb98-45ee-b4f8-42c740ec8d7d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:51.132656 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-dad4be09-fb98-45ee-b4f8-42c740ec8d7d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:51.133123 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-dad4be09-fb98-45ee-b4f8-42c740ec8d7d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:51.175902 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-dad4be09-fb98-45ee-b4f8-42c740ec8d7d tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067537 Aug 31 01:28:51.176743 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 364/733] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 01:28:51 2022] GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 01:28:51.266854 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-12f5abb4-d90b-4548-bd55-a58ac8afbb19 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:51.267488 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-12f5abb4-d90b-4548-bd55-a58ac8afbb19 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:51.273383 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-12f5abb4-d90b-4548-bd55-a58ac8afbb19 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:51.273981 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-12f5abb4-d90b-4548-bd55-a58ac8afbb19 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:51.274556 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-12f5abb4-d90b-4548-bd55-a58ac8afbb19 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:51.275578 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-12f5abb4-d90b-4548-bd55-a58ac8afbb19 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:51.276126 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-12f5abb4-d90b-4548-bd55-a58ac8afbb19 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:51.277193 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-12f5abb4-d90b-4548-bd55-a58ac8afbb19 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:51.298157 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-d6130251-7113-43fa-b7b8-205f043f99af tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:51.303609 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-12f5abb4-d90b-4548-bd55-a58ac8afbb19 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac] Going to try to terminate instance {{(pid=121026) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 01:28:51.306523 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-d6130251-7113-43fa-b7b8-205f043f99af tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1359 microversion: 2.1 time: 0.191151 Aug 31 01:28:51.306927 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell1:SELECT=100 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:28:51.307505 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 370/734] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:28:51 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1359 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:28:51.313113 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-ceeda483-8cbe-436c-a1b9-70d561547295 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e6a1ed2b-107d-4130-a90f-d3b7d0725ea9"}} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:28:51.316637 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-ceeda483-8cbe-436c-a1b9-70d561547295 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: f29a15ea-aad6-4491-a2e4-602f9ee66899] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:51.326758 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ceeda483-8cbe-436c-a1b9-70d561547295 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:51.327381 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ceeda483-8cbe-436c-a1b9-70d561547295 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:51.327897 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ceeda483-8cbe-436c-a1b9-70d561547295 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:51.328831 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ceeda483-8cbe-436c-a1b9-70d561547295 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:51.329406 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ceeda483-8cbe-436c-a1b9-70d561547295 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:51.330213 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ceeda483-8cbe-436c-a1b9-70d561547295 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:52.064909 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-12f5abb4-d90b-4548-bd55-a58ac8afbb19 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac" status: 204 len: 0 microversion: 2.1 time: 0.803183 Aug 31 01:28:52.065531 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 365/735] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 01:28:51 2022] DELETE /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac => generated 0 bytes in 805 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 01:28:52.071095 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-19dd381f-25f1-43a6-b188-d2e83991312a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:52.071792 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-19dd381f-25f1-43a6-b188-d2e83991312a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:52.077638 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-19dd381f-25f1-43a6-b188-d2e83991312a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:52.078114 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-19dd381f-25f1-43a6-b188-d2e83991312a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:52.078552 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-19dd381f-25f1-43a6-b188-d2e83991312a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:52.079234 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-19dd381f-25f1-43a6-b188-d2e83991312a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:52.079952 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-19dd381f-25f1-43a6-b188-d2e83991312a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:52.080376 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-19dd381f-25f1-43a6-b188-d2e83991312a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:52.217398 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-19dd381f-25f1-43a6-b188-d2e83991312a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:52.225405 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-19dd381f-25f1-43a6-b188-d2e83991312a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:52.226837 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-19dd381f-25f1-43a6-b188-d2e83991312a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:52.228248 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-19dd381f-25f1-43a6-b188-d2e83991312a tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1729 microversion: 2.20 time: 0.161612 Aug 31 01:28:52.228834 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 366/736] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:28:52 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:28:52.233460 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-355403f2-96a3-4d2a-b1e2-d76809af190a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:52.234062 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-355403f2-96a3-4d2a-b1e2-d76809af190a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:52.239878 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-355403f2-96a3-4d2a-b1e2-d76809af190a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:52.240358 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-355403f2-96a3-4d2a-b1e2-d76809af190a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:52.240829 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-355403f2-96a3-4d2a-b1e2-d76809af190a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:52.241519 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-355403f2-96a3-4d2a-b1e2-d76809af190a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:52.241972 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-355403f2-96a3-4d2a-b1e2-d76809af190a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:52.242394 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-355403f2-96a3-4d2a-b1e2-d76809af190a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:52.373305 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-355403f2-96a3-4d2a-b1e2-d76809af190a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:52.381615 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-355403f2-96a3-4d2a-b1e2-d76809af190a tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac" status: 200 len: 1680 microversion: 2.1 time: 0.151848 Aug 31 01:28:52.382185 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 367/737] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:28:52 2022] GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:28:52.386618 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-ba3a77eb-1ba2-41f1-9bc5-46c721103905 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:52.387242 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-ba3a77eb-1ba2-41f1-9bc5-46c721103905 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:52.392833 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ba3a77eb-1ba2-41f1-9bc5-46c721103905 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:52.393473 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ba3a77eb-1ba2-41f1-9bc5-46c721103905 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:52.401120 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ba3a77eb-1ba2-41f1-9bc5-46c721103905 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:52.401120 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ba3a77eb-1ba2-41f1-9bc5-46c721103905 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:52.401120 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ba3a77eb-1ba2-41f1-9bc5-46c721103905 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:52.401120 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ba3a77eb-1ba2-41f1-9bc5-46c721103905 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:52.492183 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-ceeda483-8cbe-436c-a1b9-70d561547295 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "POST /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.183282 Aug 31 01:28:52.493472 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 371/738] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 31 01:28:51 2022] POST /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899/os-volume_attachments => generated 194 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:28:52.527251 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-ba3a77eb-1ba2-41f1-9bc5-46c721103905 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:52.536032 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-ba3a77eb-1ba2-41f1-9bc5-46c721103905 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1359 microversion: 2.1 time: 0.152745 Aug 31 01:28:52.560056 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 368/739] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:28:52 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:28:53.252203 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-11c1992c-7512-435c-bd88-31062b1bfaab tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:53.252943 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-11c1992c-7512-435c-bd88-31062b1bfaab tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:53.259040 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-11c1992c-7512-435c-bd88-31062b1bfaab tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:53.259522 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-11c1992c-7512-435c-bd88-31062b1bfaab tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:53.259952 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-11c1992c-7512-435c-bd88-31062b1bfaab tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:53.260631 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-11c1992c-7512-435c-bd88-31062b1bfaab tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:53.261108 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-11c1992c-7512-435c-bd88-31062b1bfaab tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:53.261522 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-11c1992c-7512-435c-bd88-31062b1bfaab tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:53.397213 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-11c1992c-7512-435c-bd88-31062b1bfaab tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:53.403473 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-63da5091-4b69-4c10-9bd2-ea49aeac53e2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:53.404212 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-63da5091-4b69-4c10-9bd2-ea49aeac53e2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:53.405546 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-11c1992c-7512-435c-bd88-31062b1bfaab tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:53.406957 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-11c1992c-7512-435c-bd88-31062b1bfaab tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:53.408105 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-11c1992c-7512-435c-bd88-31062b1bfaab tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1729 microversion: 2.20 time: 0.160640 Aug 31 01:28:53.408693 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 372/740] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:28:53 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 01:28:53.411017 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-63da5091-4b69-4c10-9bd2-ea49aeac53e2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:53.411502 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-63da5091-4b69-4c10-9bd2-ea49aeac53e2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:53.411940 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-63da5091-4b69-4c10-9bd2-ea49aeac53e2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:53.412635 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-63da5091-4b69-4c10-9bd2-ea49aeac53e2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:53.413114 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-63da5091-4b69-4c10-9bd2-ea49aeac53e2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:53.413533 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-63da5091-4b69-4c10-9bd2-ea49aeac53e2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:53.545657 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-63da5091-4b69-4c10-9bd2-ea49aeac53e2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:53.554832 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-63da5091-4b69-4c10-9bd2-ea49aeac53e2 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac" status: 200 len: 1680 microversion: 2.1 time: 0.155177 Aug 31 01:28:53.555408 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 369/741] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:28:53 2022] GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:28:53.557183 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-0eff2774-ba69-42a4-b945-f12052c95e97 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:53.557789 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-0eff2774-ba69-42a4-b945-f12052c95e97 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:53.565361 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0eff2774-ba69-42a4-b945-f12052c95e97 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:53.565771 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0eff2774-ba69-42a4-b945-f12052c95e97 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:53.566386 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0eff2774-ba69-42a4-b945-f12052c95e97 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:53.568033 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0eff2774-ba69-42a4-b945-f12052c95e97 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:53.568694 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0eff2774-ba69-42a4-b945-f12052c95e97 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:53.569350 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0eff2774-ba69-42a4-b945-f12052c95e97 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:53.708601 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-0eff2774-ba69-42a4-b945-f12052c95e97 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:53.716886 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-0eff2774-ba69-42a4-b945-f12052c95e97 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1359 microversion: 2.1 time: 0.163358 Aug 31 01:28:53.717460 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 373/742] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:28:53 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:28:54.432262 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-c5aa0263-7e40-43f5-8623-336e91e1f39f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:54.432901 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-c5aa0263-7e40-43f5-8623-336e91e1f39f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:54.441111 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c5aa0263-7e40-43f5-8623-336e91e1f39f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:54.441111 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c5aa0263-7e40-43f5-8623-336e91e1f39f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:54.441538 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c5aa0263-7e40-43f5-8623-336e91e1f39f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:54.442287 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c5aa0263-7e40-43f5-8623-336e91e1f39f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:54.442735 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c5aa0263-7e40-43f5-8623-336e91e1f39f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:54.443154 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c5aa0263-7e40-43f5-8623-336e91e1f39f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:54.502446 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-48f28376-92e0-48cb-b54e-bf758c899687 req-723f0bea-bd71-4f15-9a04-6aee1de60d13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac", "name": "network-vif-deleted", "tag": "efe8dede-55a6-41b6-97f0-2979138ce376"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:28:54.512829 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-48f28376-92e0-48cb-b54e-bf758c899687 req-723f0bea-bd71-4f15-9a04-6aee1de60d13 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:54.514115 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-48f28376-92e0-48cb-b54e-bf758c899687 req-723f0bea-bd71-4f15-9a04-6aee1de60d13 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:54.514115 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-48f28376-92e0-48cb-b54e-bf758c899687 req-723f0bea-bd71-4f15-9a04-6aee1de60d13 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:54.526813 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-48f28376-92e0-48cb-b54e-bf758c899687 req-723f0bea-bd71-4f15-9a04-6aee1de60d13 service nova] Creating event network-vif-deleted:efe8dede-55a6-41b6-97f0-2979138ce376 for instance 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac on hv-cinder-85528 Aug 31 01:28:54.531713 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-48f28376-92e0-48cb-b54e-bf758c899687 req-723f0bea-bd71-4f15-9a04-6aee1de60d13 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033191 Aug 31 01:28:54.532314 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 374/743] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:28:54.579302 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-b6a6e998-9613-4e59-a9d1-309ef603c090 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:54.581390 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-b6a6e998-9613-4e59-a9d1-309ef603c090 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:54.590132 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b6a6e998-9613-4e59-a9d1-309ef603c090 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:54.591021 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b6a6e998-9613-4e59-a9d1-309ef603c090 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:54.591869 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b6a6e998-9613-4e59-a9d1-309ef603c090 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:54.593554 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b6a6e998-9613-4e59-a9d1-309ef603c090 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:54.594174 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b6a6e998-9613-4e59-a9d1-309ef603c090 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:54.594741 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b6a6e998-9613-4e59-a9d1-309ef603c090 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:54.607319 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-c5aa0263-7e40-43f5-8623-336e91e1f39f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:54.618001 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-c5aa0263-7e40-43f5-8623-336e91e1f39f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:54.620053 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-c5aa0263-7e40-43f5-8623-336e91e1f39f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:54.621633 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-c5aa0263-7e40-43f5-8623-336e91e1f39f tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1716 microversion: 2.20 time: 0.193461 Aug 31 01:28:54.622791 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 370/744] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:28:54 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1716 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:28:54.687269 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-b6a6e998-9613-4e59-a9d1-309ef603c090 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:54.699601 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-b6a6e998-9613-4e59-a9d1-309ef603c090 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac" status: 200 len: 1612 microversion: 2.1 time: 0.123303 Aug 31 01:28:54.720946 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 375/745] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:28:54 2022] GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac => generated 1612 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:28:54.739075 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-0e2c2d24-3972-4459-9485-be496d85627e tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:54.739792 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-0e2c2d24-3972-4459-9485-be496d85627e tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:54.746475 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0e2c2d24-3972-4459-9485-be496d85627e tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:54.753797 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0e2c2d24-3972-4459-9485-be496d85627e tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:54.753797 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0e2c2d24-3972-4459-9485-be496d85627e tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:54.753797 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0e2c2d24-3972-4459-9485-be496d85627e tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:54.753797 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0e2c2d24-3972-4459-9485-be496d85627e tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:54.754215 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0e2c2d24-3972-4459-9485-be496d85627e tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:54.890696 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-0e2c2d24-3972-4459-9485-be496d85627e tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:54.904867 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-0e2c2d24-3972-4459-9485-be496d85627e tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1359 microversion: 2.1 time: 0.169929 Aug 31 01:28:54.905563 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 371/746] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:28:54 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:28:55.027314 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-a1d4c91a-6e7d-4701-9148-daff2a8dd8f1 req-fc7a6f4e-6d4d-47a5-93f8-52cab81636b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa12f850-924b-4bc9-8f32-c3f25e4a4d7d", "name": "network-vif-plugged", "status": "completed", "tag": "9a52ea97-a4a8-4c98-835c-b0b492daa956"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:28:55.036407 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-a1d4c91a-6e7d-4701-9148-daff2a8dd8f1 req-fc7a6f4e-6d4d-47a5-93f8-52cab81636b2 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:55.036923 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-a1d4c91a-6e7d-4701-9148-daff2a8dd8f1 req-fc7a6f4e-6d4d-47a5-93f8-52cab81636b2 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:55.037351 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-a1d4c91a-6e7d-4701-9148-daff2a8dd8f1 req-fc7a6f4e-6d4d-47a5-93f8-52cab81636b2 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:55.048156 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-a1d4c91a-6e7d-4701-9148-daff2a8dd8f1 req-fc7a6f4e-6d4d-47a5-93f8-52cab81636b2 service nova] Creating event network-vif-plugged:9a52ea97-a4a8-4c98-835c-b0b492daa956 for instance aa12f850-924b-4bc9-8f32-c3f25e4a4d7d on hv-cinder-85528 Aug 31 01:28:55.053609 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-a1d4c91a-6e7d-4701-9148-daff2a8dd8f1 req-fc7a6f4e-6d4d-47a5-93f8-52cab81636b2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029963 Aug 31 01:28:55.054211 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 376/747] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:28:55.726097 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-40876c3c-4000-4979-a6b7-2ba7ffe9e642 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:55.726807 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-40876c3c-4000-4979-a6b7-2ba7ffe9e642 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:55.733218 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-40876c3c-4000-4979-a6b7-2ba7ffe9e642 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:55.737547 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-40876c3c-4000-4979-a6b7-2ba7ffe9e642 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:55.737547 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-40876c3c-4000-4979-a6b7-2ba7ffe9e642 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:55.737547 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-40876c3c-4000-4979-a6b7-2ba7ffe9e642 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:55.737547 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-40876c3c-4000-4979-a6b7-2ba7ffe9e642 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:55.737922 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-40876c3c-4000-4979-a6b7-2ba7ffe9e642 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:55.783886 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-40876c3c-4000-4979-a6b7-2ba7ffe9e642 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:55.784524 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-40876c3c-4000-4979-a6b7-2ba7ffe9e642 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:55.788686 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-40876c3c-4000-4979-a6b7-2ba7ffe9e642 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:55.789512 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.objects.instance [None req-40876c3c-4000-4979-a6b7-2ba7ffe9e642 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lazy-loading 'fault' on Instance uuid 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac {{(pid=121026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:28:55.833229 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-40876c3c-4000-4979-a6b7-2ba7ffe9e642 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ed99737fd240789bb682fd9bf11be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164da7d4776d4e9f8cf6497aa784d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:55.840062 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-40876c3c-4000-4979-a6b7-2ba7ffe9e642 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac" status: 200 len: 1330 microversion: 2.1 time: 0.118726 Aug 31 01:28:55.840627 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 372/748] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:28:55 2022] GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac => generated 1330 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:28:55.927246 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-9d03396c-8324-401c-b788-ddb8bf1e813d tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:56.004861 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-9d03396c-8324-401c-b788-ddb8bf1e813d tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:56.004861 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9d03396c-8324-401c-b788-ddb8bf1e813d tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:56.004861 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9d03396c-8324-401c-b788-ddb8bf1e813d tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:56.004861 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9d03396c-8324-401c-b788-ddb8bf1e813d tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:56.005292 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9d03396c-8324-401c-b788-ddb8bf1e813d tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:56.005292 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9d03396c-8324-401c-b788-ddb8bf1e813d tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:56.005292 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9d03396c-8324-401c-b788-ddb8bf1e813d tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:56.079221 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-9d03396c-8324-401c-b788-ddb8bf1e813d tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:56.087088 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-9d03396c-8324-401c-b788-ddb8bf1e813d tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1359 microversion: 2.1 time: 0.165034 Aug 31 01:28:56.087645 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 377/749] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:28:55 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:28:56.861612 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-a4872408-e6b2-409a-836f-4d03647ccc97 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:56.862244 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-a4872408-e6b2-409a-836f-4d03647ccc97 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:56.868986 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a4872408-e6b2-409a-836f-4d03647ccc97 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:56.869470 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a4872408-e6b2-409a-836f-4d03647ccc97 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:56.869924 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a4872408-e6b2-409a-836f-4d03647ccc97 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:56.870639 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a4872408-e6b2-409a-836f-4d03647ccc97 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:56.871083 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a4872408-e6b2-409a-836f-4d03647ccc97 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:56.871497 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a4872408-e6b2-409a-836f-4d03647ccc97 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:56.885227 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.wsgi [None req-a4872408-e6b2-409a-836f-4d03647ccc97 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] HTTP exception thrown: Instance 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac could not be found. Aug 31 01:28:56.886897 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-a4872408-e6b2-409a-836f-4d03647ccc97 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Request method failure captured: Aug 31 01:28:56.886897 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: request: GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac HTTP/1.1 Aug 31 01:28:56.886897 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept: application/json Aug 31 01:28:56.886897 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept-Encoding: identity Aug 31 01:28:56.886897 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Connection: close Aug 31 01:28:56.886897 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Length: 0 Aug 31 01:28:56.886897 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Type: application/json Aug 31 01:28:56.886897 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Host: 10.222.0.20 Aug 31 01:28:56.886897 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Openstack-System-Scope: None Aug 31 01:28:56.886897 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: User-Agent: python-urllib3/1.26.12 Aug 31 01:28:56.886897 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Auth-Token: gAAAAABjDrfet2Sy4N8jKKJoN7i8trLl0KW7DYiW5JhaLj0L5xpx8IJJDKjwB1T51gnweVtzcKX7Vmb1NaayoFFPtTaITD4WxtfyhSUUM3_4_aZ5GptnzhJmrFo6ZwSNdxq7_gCewRQsJwS99WXQ3X8vSLGTrSznkbNFB8yNJvuQw_w6CXmffXc Aug 31 01:28:56.886897 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Id: None Aug 31 01:28:56.886897 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Name: None Aug 31 01:28:56.886897 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Identity-Status: Confirmed Aug 31 01:28:56.886897 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Is-Admin-Project: True Aug 31 01:28:56.886897 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Id: default Aug 31 01:28:56.886897 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Name: Default Aug 31 01:28:56.886897 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Id: 164da7d4776d4e9f8cf6497aa784d312 Aug 31 01:28:56.886897 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Name: tempest-AttachVolumeNegativeTest-1582720348 Aug 31 01:28:56.886897 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Role: member,reader Aug 31 01:28:56.886897 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Roles: member,reader Aug 31 01:28:56.888507 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/164da7d4776d4e9f8cf6497aa784d312"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_164da7d4776d4e9f8cf6497aa784d312", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/164da7d4776d4e9f8cf6497aa784d312"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/164da7d4776d4e9f8cf6497aa784d312"}]}] Aug 31 01:28:56.888507 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant: tempest-AttachVolumeNegativeTest-1582720348 Aug 31 01:28:56.888507 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Id: 164da7d4776d4e9f8cf6497aa784d312 Aug 31 01:28:56.888507 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1582720348 Aug 31 01:28:56.888507 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User: tempest-AttachVolumeNegativeTest-1582720348-project Aug 31 01:28:56.888507 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Id: default Aug 31 01:28:56.888507 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Name: Default Aug 31 01:28:56.888507 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Id: 52ed99737fd240789bb682fd9bf11be3 Aug 31 01:28:56.888507 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Name: tempest-AttachVolumeNegativeTest-1582720348-project Aug 31 01:28:56.888507 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: method: > Aug 31 01:28:56.888507 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: exception: Instance 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac could not be found. Aug 31 01:28:56.888507 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: action_args: {'id': '2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac'} Aug 31 01:28:56.889501 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:28:56.889501 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:28:56.889501 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:28:56.889501 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:28:56.889501 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:28:56.889501 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:28:56.889501 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:28:56.889501 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:28:56.889501 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:28:56.889501 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:28:56.889501 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac could not be found. Aug 31 01:28:56.889501 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:28:56.889501 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:28:56.889501 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:28:56.889501 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:28:56.889501 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:28:56.889501 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:28:56.889501 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:28:56.889501 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:28:56.889501 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:28:56.891069 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:28:56.891069 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:28:56.891069 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:28:56.891069 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:28:56.891069 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:28:56.891069 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:28:56.891069 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:28:56.891069 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac could not be found. Aug 31 01:28:56.891069 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:28:56.891069 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:28:56.891069 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:28:56.891069 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:28:56.891069 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:28:56.891069 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:28:56.891069 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:28:56.891069 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:28:56.891069 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac could not be found. Aug 31 01:28:56.891069 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:28:56.892404 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-a4872408-e6b2-409a-836f-4d03647ccc97 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Returning 404 to user: Instance 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac could not be found. {{(pid=121026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:28:56.892404 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-a4872408-e6b2-409a-836f-4d03647ccc97 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac" status: 404 len: 111 microversion: 2.1 time: 0.030577 Aug 31 01:28:56.892404 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 373/750] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:28:56 2022] GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:28:56.898113 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-d31a72bc-9da8-48c7-b9a6-c489f162fdf9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '.version_select at 0x7f1fe15ca4c0>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:57.002015 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-d31a72bc-9da8-48c7-b9a6-c489f162fdf9 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-860954878" status: 202 len: 0 microversion: 2.1 time: 0.108438 Aug 31 01:28:57.002657 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 378/751] 10.222.0.20 () {58 vars in 1218 bytes} [Wed Aug 31 01:28:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-860954878 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 01:28:57.107551 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-c7675088-da2b-459a-a699-e5080abcb40c tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:57.108186 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-c7675088-da2b-459a-a699-e5080abcb40c tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:57.114572 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c7675088-da2b-459a-a699-e5080abcb40c tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:57.117979 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c7675088-da2b-459a-a699-e5080abcb40c tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:57.117979 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c7675088-da2b-459a-a699-e5080abcb40c tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:57.117979 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c7675088-da2b-459a-a699-e5080abcb40c tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:57.117979 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c7675088-da2b-459a-a699-e5080abcb40c tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:57.118394 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c7675088-da2b-459a-a699-e5080abcb40c tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:57.262335 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-c7675088-da2b-459a-a699-e5080abcb40c tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:57.270336 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-c7675088-da2b-459a-a699-e5080abcb40c tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1550 microversion: 2.1 time: 0.166757 Aug 31 01:28:57.270901 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 374/752] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:28:57 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1550 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:28:57.290323 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-2abe5813-222a-4c93-8db6-fac7fd7194c7 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:57.295709 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-2abe5813-222a-4c93-8db6-fac7fd7194c7 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:57.297195 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2abe5813-222a-4c93-8db6-fac7fd7194c7 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:57.297868 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2abe5813-222a-4c93-8db6-fac7fd7194c7 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:57.298491 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2abe5813-222a-4c93-8db6-fac7fd7194c7 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:57.299186 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2abe5813-222a-4c93-8db6-fac7fd7194c7 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:57.299638 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2abe5813-222a-4c93-8db6-fac7fd7194c7 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:57.300058 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2abe5813-222a-4c93-8db6-fac7fd7194c7 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:57.430620 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-2abe5813-222a-4c93-8db6-fac7fd7194c7 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:57.438310 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-2abe5813-222a-4c93-8db6-fac7fd7194c7 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1550 microversion: 2.1 time: 0.152011 Aug 31 01:28:57.438882 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 379/753] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:28:57 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1550 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:28:57.458031 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-3234c64f-d1b1-4a10-9d2a-5ccb97252bf3 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:57.463003 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-3234c64f-d1b1-4a10-9d2a-5ccb97252bf3 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:57.463846 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-3234c64f-d1b1-4a10-9d2a-5ccb97252bf3 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Searching by: {'deleted': False, 'project_id': '9befc65a9da84a99942b803ac6a15a0b'} {{(pid=121026) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 01:28:57.470564 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3234c64f-d1b1-4a10-9d2a-5ccb97252bf3 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:57.471115 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3234c64f-d1b1-4a10-9d2a-5ccb97252bf3 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:57.471655 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3234c64f-d1b1-4a10-9d2a-5ccb97252bf3 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:57.472383 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3234c64f-d1b1-4a10-9d2a-5ccb97252bf3 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:57.472863 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3234c64f-d1b1-4a10-9d2a-5ccb97252bf3 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:57.473791 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3234c64f-d1b1-4a10-9d2a-5ccb97252bf3 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:57.564376 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.multi_cell_list [None req-3234c64f-d1b1-4a10-9d2a-5ccb97252bf3 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121026) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 01:28:57.655987 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-3234c64f-d1b1-4a10-9d2a-5ccb97252bf3 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.201984 Aug 31 01:28:57.656693 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 375/754] 10.222.0.20 () {58 vars in 1125 bytes} [Wed Aug 31 01:28:57 2022] GET /compute/v2.1/servers => generated 343 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:28:57.668322 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-a27d4894-264a-4c83-911c-5a6701ebfbdc tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:57.670317 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-a27d4894-264a-4c83-911c-5a6701ebfbdc tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:57.675305 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a27d4894-264a-4c83-911c-5a6701ebfbdc tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:57.675802 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a27d4894-264a-4c83-911c-5a6701ebfbdc tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:57.677563 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a27d4894-264a-4c83-911c-5a6701ebfbdc tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:57.677563 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a27d4894-264a-4c83-911c-5a6701ebfbdc tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:57.677987 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a27d4894-264a-4c83-911c-5a6701ebfbdc tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:57.678444 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a27d4894-264a-4c83-911c-5a6701ebfbdc tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:57.825495 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-a27d4894-264a-4c83-911c-5a6701ebfbdc tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:28:57.833366 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-a27d4894-264a-4c83-911c-5a6701ebfbdc tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1550 microversion: 2.1 time: 0.168936 Aug 31 01:28:57.833936 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 380/755] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:28:57 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1550 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:28:59.033531 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-372d6ba7-4d3d-4907-88a5-3bfb99d73c55 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:59.034027 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-372d6ba7-4d3d-4907-88a5-3bfb99d73c55 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:59.040941 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-372d6ba7-4d3d-4907-88a5-3bfb99d73c55 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:59.041423 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-372d6ba7-4d3d-4907-88a5-3bfb99d73c55 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:59.041858 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-372d6ba7-4d3d-4907-88a5-3bfb99d73c55 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:59.042546 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-372d6ba7-4d3d-4907-88a5-3bfb99d73c55 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:59.042996 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-372d6ba7-4d3d-4907-88a5-3bfb99d73c55 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:59.043414 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-372d6ba7-4d3d-4907-88a5-3bfb99d73c55 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:59.056908 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.wsgi [None req-372d6ba7-4d3d-4907-88a5-3bfb99d73c55 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] HTTP exception thrown: Instance 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac could not be found. Aug 31 01:28:59.058414 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-372d6ba7-4d3d-4907-88a5-3bfb99d73c55 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Request method failure captured: Aug 31 01:28:59.058414 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: request: DELETE /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac HTTP/1.1 Aug 31 01:28:59.058414 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept: application/json Aug 31 01:28:59.058414 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept-Encoding: identity Aug 31 01:28:59.058414 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Connection: close Aug 31 01:28:59.058414 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Length: 0 Aug 31 01:28:59.058414 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Type: application/json Aug 31 01:28:59.058414 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Host: 10.222.0.20 Aug 31 01:28:59.058414 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Openstack-System-Scope: None Aug 31 01:28:59.058414 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: User-Agent: python-urllib3/1.26.12 Aug 31 01:28:59.058414 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Auth-Token: gAAAAABjDrfet2Sy4N8jKKJoN7i8trLl0KW7DYiW5JhaLj0L5xpx8IJJDKjwB1T51gnweVtzcKX7Vmb1NaayoFFPtTaITD4WxtfyhSUUM3_4_aZ5GptnzhJmrFo6ZwSNdxq7_gCewRQsJwS99WXQ3X8vSLGTrSznkbNFB8yNJvuQw_w6CXmffXc Aug 31 01:28:59.058414 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Id: None Aug 31 01:28:59.058414 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Name: None Aug 31 01:28:59.058414 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Identity-Status: Confirmed Aug 31 01:28:59.058414 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Is-Admin-Project: True Aug 31 01:28:59.058414 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Id: default Aug 31 01:28:59.058414 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Name: Default Aug 31 01:28:59.058414 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Id: 164da7d4776d4e9f8cf6497aa784d312 Aug 31 01:28:59.058414 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Name: tempest-AttachVolumeNegativeTest-1582720348 Aug 31 01:28:59.058414 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Role: member,reader Aug 31 01:28:59.058414 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Roles: member,reader Aug 31 01:28:59.060003 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/164da7d4776d4e9f8cf6497aa784d312"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_164da7d4776d4e9f8cf6497aa784d312", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/164da7d4776d4e9f8cf6497aa784d312"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/164da7d4776d4e9f8cf6497aa784d312"}]}] Aug 31 01:28:59.060003 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant: tempest-AttachVolumeNegativeTest-1582720348 Aug 31 01:28:59.060003 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Id: 164da7d4776d4e9f8cf6497aa784d312 Aug 31 01:28:59.060003 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1582720348 Aug 31 01:28:59.060003 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User: tempest-AttachVolumeNegativeTest-1582720348-project Aug 31 01:28:59.060003 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Id: default Aug 31 01:28:59.060003 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Name: Default Aug 31 01:28:59.060003 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Id: 52ed99737fd240789bb682fd9bf11be3 Aug 31 01:28:59.060003 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Name: tempest-AttachVolumeNegativeTest-1582720348-project Aug 31 01:28:59.060003 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: method: > Aug 31 01:28:59.060003 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: exception: Instance 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac could not be found. Aug 31 01:28:59.060003 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: action_args: {'id': '2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac'} Aug 31 01:28:59.061078 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:28:59.061078 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:28:59.061078 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:28:59.061078 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:28:59.061078 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:28:59.061078 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:28:59.061078 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:28:59.061078 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:28:59.061078 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:28:59.061078 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:28:59.061078 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac could not be found. Aug 31 01:28:59.061078 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:28:59.061078 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:28:59.061078 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:28:59.061078 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:28:59.061078 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:28:59.061078 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:28:59.061078 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:28:59.061078 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:28:59.061078 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:28:59.062542 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:28:59.062542 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 01:28:59.062542 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 01:28:59.062542 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 01:28:59.062542 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 01:28:59.062542 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:28:59.062542 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:28:59.062542 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:28:59.062542 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:28:59.062542 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac could not be found. Aug 31 01:28:59.062542 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:28:59.062542 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:28:59.062542 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:28:59.062542 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:28:59.062542 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:28:59.062542 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:28:59.062542 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:28:59.062542 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:28:59.062542 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac could not be found. Aug 31 01:28:59.062542 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:28:59.064065 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-372d6ba7-4d3d-4907-88a5-3bfb99d73c55 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Returning 404 to user: Instance 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac could not be found. {{(pid=121026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:28:59.064065 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-372d6ba7-4d3d-4907-88a5-3bfb99d73c55 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac" status: 404 len: 111 microversion: 2.1 time: 0.030132 Aug 31 01:28:59.064065 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 376/756] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 01:28:59 2022] DELETE /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:28:59.067953 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-7b935ffd-e670-4a43-bdf7-016c7545c110 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:28:59.068555 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-7b935ffd-e670-4a43-bdf7-016c7545c110 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:59.074725 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7b935ffd-e670-4a43-bdf7-016c7545c110 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:59.075202 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7b935ffd-e670-4a43-bdf7-016c7545c110 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:59.075631 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7b935ffd-e670-4a43-bdf7-016c7545c110 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:59.076307 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7b935ffd-e670-4a43-bdf7-016c7545c110 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:59.076769 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7b935ffd-e670-4a43-bdf7-016c7545c110 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:59.077188 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7b935ffd-e670-4a43-bdf7-016c7545c110 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:59.090404 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.wsgi [None req-7b935ffd-e670-4a43-bdf7-016c7545c110 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] HTTP exception thrown: Instance 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac could not be found. Aug 31 01:28:59.091992 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-7b935ffd-e670-4a43-bdf7-016c7545c110 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Request method failure captured: Aug 31 01:28:59.091992 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: request: GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac HTTP/1.1 Aug 31 01:28:59.091992 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept: application/json Aug 31 01:28:59.091992 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept-Encoding: identity Aug 31 01:28:59.091992 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Connection: close Aug 31 01:28:59.091992 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Length: 0 Aug 31 01:28:59.091992 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Type: application/json Aug 31 01:28:59.091992 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Host: 10.222.0.20 Aug 31 01:28:59.091992 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Openstack-System-Scope: None Aug 31 01:28:59.091992 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: User-Agent: python-urllib3/1.26.12 Aug 31 01:28:59.091992 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Auth-Token: gAAAAABjDrfet2Sy4N8jKKJoN7i8trLl0KW7DYiW5JhaLj0L5xpx8IJJDKjwB1T51gnweVtzcKX7Vmb1NaayoFFPtTaITD4WxtfyhSUUM3_4_aZ5GptnzhJmrFo6ZwSNdxq7_gCewRQsJwS99WXQ3X8vSLGTrSznkbNFB8yNJvuQw_w6CXmffXc Aug 31 01:28:59.091992 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Id: None Aug 31 01:28:59.091992 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Name: None Aug 31 01:28:59.091992 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Identity-Status: Confirmed Aug 31 01:28:59.091992 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Is-Admin-Project: True Aug 31 01:28:59.091992 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Id: default Aug 31 01:28:59.091992 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Name: Default Aug 31 01:28:59.091992 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Id: 164da7d4776d4e9f8cf6497aa784d312 Aug 31 01:28:59.091992 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Name: tempest-AttachVolumeNegativeTest-1582720348 Aug 31 01:28:59.091992 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Role: member,reader Aug 31 01:28:59.091992 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Roles: member,reader Aug 31 01:28:59.093569 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/164da7d4776d4e9f8cf6497aa784d312"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_164da7d4776d4e9f8cf6497aa784d312", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/164da7d4776d4e9f8cf6497aa784d312"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/164da7d4776d4e9f8cf6497aa784d312"}]}] Aug 31 01:28:59.093569 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant: tempest-AttachVolumeNegativeTest-1582720348 Aug 31 01:28:59.093569 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Id: 164da7d4776d4e9f8cf6497aa784d312 Aug 31 01:28:59.093569 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1582720348 Aug 31 01:28:59.093569 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User: tempest-AttachVolumeNegativeTest-1582720348-project Aug 31 01:28:59.093569 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Id: default Aug 31 01:28:59.093569 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Name: Default Aug 31 01:28:59.093569 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Id: 52ed99737fd240789bb682fd9bf11be3 Aug 31 01:28:59.093569 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Name: tempest-AttachVolumeNegativeTest-1582720348-project Aug 31 01:28:59.093569 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: method: > Aug 31 01:28:59.093569 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: exception: Instance 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac could not be found. Aug 31 01:28:59.093569 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: action_args: {'id': '2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac'} Aug 31 01:28:59.097259 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:28:59.097259 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:28:59.097259 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:28:59.097259 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:28:59.097259 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:28:59.097259 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:28:59.097259 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:28:59.097259 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:28:59.097259 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:28:59.097259 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:28:59.097259 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac could not be found. Aug 31 01:28:59.097259 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:28:59.097259 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:28:59.097259 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:28:59.097259 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:28:59.097259 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:28:59.097259 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:28:59.097259 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:28:59.097259 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:28:59.097259 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:28:59.099216 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:28:59.099216 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:28:59.099216 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:28:59.099216 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:28:59.099216 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:28:59.099216 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:28:59.099216 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:28:59.099216 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac could not be found. Aug 31 01:28:59.099216 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:28:59.099216 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:28:59.099216 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:28:59.099216 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:28:59.099216 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:28:59.099216 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:28:59.099216 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:28:59.099216 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:28:59.099216 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac could not be found. Aug 31 01:28:59.099216 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:28:59.100594 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-7b935ffd-e670-4a43-bdf7-016c7545c110 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Returning 404 to user: Instance 2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac could not be found. {{(pid=121025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:28:59.100594 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-7b935ffd-e670-4a43-bdf7-016c7545c110 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac" status: 404 len: 111 microversion: 2.1 time: 0.029210 Aug 31 01:28:59.100594 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 381/757] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:28:59 2022] GET /compute/v2.1/servers/2763dc0f-ab5c-4b32-9c03-5c5fcdf319ac => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 01:28:59.901881 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-3df82581-3e59-4ffc-a7e5-8e367f5e9bbc tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d34645a2-ac86-4b40-b221-a051ae0c3885"}} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:28:59.904203 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-3df82581-3e59-4ffc-a7e5-8e367f5e9bbc tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:28:59.909997 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3df82581-3e59-4ffc-a7e5-8e367f5e9bbc tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:59.910503 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3df82581-3e59-4ffc-a7e5-8e367f5e9bbc tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:59.910930 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3df82581-3e59-4ffc-a7e5-8e367f5e9bbc tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:28:59.911609 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3df82581-3e59-4ffc-a7e5-8e367f5e9bbc tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:28:59.912051 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3df82581-3e59-4ffc-a7e5-8e367f5e9bbc tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:28:59.912466 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3df82581-3e59-4ffc-a7e5-8e367f5e9bbc tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:00.408807 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-26f9eb58-6e27-43bd-97ab-5f75a1490431 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:00.409286 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-26f9eb58-6e27-43bd-97ab-5f75a1490431 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: acd1b630-d842-47ea-8019-f405c41ad7d3] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:00.417653 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-26f9eb58-6e27-43bd-97ab-5f75a1490431 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:00.417966 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-26f9eb58-6e27-43bd-97ab-5f75a1490431 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:00.418413 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-26f9eb58-6e27-43bd-97ab-5f75a1490431 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:00.419100 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-26f9eb58-6e27-43bd-97ab-5f75a1490431 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:00.419550 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-26f9eb58-6e27-43bd-97ab-5f75a1490431 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:00.420251 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-26f9eb58-6e27-43bd-97ab-5f75a1490431 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:00.435679 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.wsgi [None req-26f9eb58-6e27-43bd-97ab-5f75a1490431 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] HTTP exception thrown: Instance acd1b630-d842-47ea-8019-f405c41ad7d3 could not be found. Aug 31 01:29:00.437197 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-26f9eb58-6e27-43bd-97ab-5f75a1490431 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Request method failure captured: Aug 31 01:29:00.437197 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: request: DELETE /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3 HTTP/1.1 Aug 31 01:29:00.437197 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept: application/json Aug 31 01:29:00.437197 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept-Encoding: identity Aug 31 01:29:00.437197 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Connection: close Aug 31 01:29:00.437197 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Length: 0 Aug 31 01:29:00.437197 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Type: application/json Aug 31 01:29:00.437197 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Host: 10.222.0.20 Aug 31 01:29:00.437197 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Openstack-System-Scope: None Aug 31 01:29:00.437197 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: User-Agent: python-urllib3/1.26.12 Aug 31 01:29:00.437197 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Auth-Token: gAAAAABjDrfet2Sy4N8jKKJoN7i8trLl0KW7DYiW5JhaLj0L5xpx8IJJDKjwB1T51gnweVtzcKX7Vmb1NaayoFFPtTaITD4WxtfyhSUUM3_4_aZ5GptnzhJmrFo6ZwSNdxq7_gCewRQsJwS99WXQ3X8vSLGTrSznkbNFB8yNJvuQw_w6CXmffXc Aug 31 01:29:00.437197 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Id: None Aug 31 01:29:00.437197 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Name: None Aug 31 01:29:00.437197 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Identity-Status: Confirmed Aug 31 01:29:00.437197 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Is-Admin-Project: True Aug 31 01:29:00.437197 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Id: default Aug 31 01:29:00.437197 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Name: Default Aug 31 01:29:00.437197 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Id: 164da7d4776d4e9f8cf6497aa784d312 Aug 31 01:29:00.437197 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Name: tempest-AttachVolumeNegativeTest-1582720348 Aug 31 01:29:00.437197 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Role: member,reader Aug 31 01:29:00.437197 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Roles: member,reader Aug 31 01:29:00.438850 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/164da7d4776d4e9f8cf6497aa784d312"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_164da7d4776d4e9f8cf6497aa784d312", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/164da7d4776d4e9f8cf6497aa784d312"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/164da7d4776d4e9f8cf6497aa784d312"}]}] Aug 31 01:29:00.438850 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant: tempest-AttachVolumeNegativeTest-1582720348 Aug 31 01:29:00.438850 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Id: 164da7d4776d4e9f8cf6497aa784d312 Aug 31 01:29:00.438850 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1582720348 Aug 31 01:29:00.438850 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User: tempest-AttachVolumeNegativeTest-1582720348-project Aug 31 01:29:00.438850 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Id: default Aug 31 01:29:00.438850 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Name: Default Aug 31 01:29:00.438850 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Id: 52ed99737fd240789bb682fd9bf11be3 Aug 31 01:29:00.438850 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Name: tempest-AttachVolumeNegativeTest-1582720348-project Aug 31 01:29:00.438850 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: method: > Aug 31 01:29:00.438850 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: exception: Instance acd1b630-d842-47ea-8019-f405c41ad7d3 could not be found. Aug 31 01:29:00.438850 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: action_args: {'id': 'acd1b630-d842-47ea-8019-f405c41ad7d3'} Aug 31 01:29:00.439767 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:29:00.439767 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:00.439767 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:29:00.439767 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:29:00.439767 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:29:00.439767 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:29:00.439767 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:29:00.439767 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:29:00.439767 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:29:00.439767 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:29:00.439767 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acd1b630-d842-47ea-8019-f405c41ad7d3 could not be found. Aug 31 01:29:00.439767 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:00.439767 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:00.439767 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:00.439767 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:00.439767 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:00.439767 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:00.439767 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:29:00.439767 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:29:00.439767 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:29:00.441445 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:29:00.441445 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 01:29:00.441445 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 01:29:00.441445 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 01:29:00.441445 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 01:29:00.441445 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:29:00.441445 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:29:00.441445 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:29:00.441445 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:29:00.441445 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acd1b630-d842-47ea-8019-f405c41ad7d3 could not be found. Aug 31 01:29:00.441445 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:00.441445 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:00.441445 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:00.441445 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:00.441445 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:00.441445 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:00.441445 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:29:00.441445 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:29:00.441445 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acd1b630-d842-47ea-8019-f405c41ad7d3 could not be found. Aug 31 01:29:00.441445 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:00.448843 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-26f9eb58-6e27-43bd-97ab-5f75a1490431 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Returning 404 to user: Instance acd1b630-d842-47ea-8019-f405c41ad7d3 could not be found. {{(pid=121025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:29:00.448843 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-26f9eb58-6e27-43bd-97ab-5f75a1490431 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "DELETE /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3" status: 404 len: 111 microversion: 2.1 time: 0.036350 Aug 31 01:29:00.448843 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 382/758] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 01:29:00 2022] DELETE /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:29:00.449975 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-b449c691-eb5a-44f0-96f2-135547e65e25 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:00.450579 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-b449c691-eb5a-44f0-96f2-135547e65e25 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: acd1b630-d842-47ea-8019-f405c41ad7d3] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:00.456898 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b449c691-eb5a-44f0-96f2-135547e65e25 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:00.457407 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b449c691-eb5a-44f0-96f2-135547e65e25 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:00.457795 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b449c691-eb5a-44f0-96f2-135547e65e25 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:00.458482 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b449c691-eb5a-44f0-96f2-135547e65e25 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:00.458956 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b449c691-eb5a-44f0-96f2-135547e65e25 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:00.459373 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b449c691-eb5a-44f0-96f2-135547e65e25 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:00.473339 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.wsgi [None req-b449c691-eb5a-44f0-96f2-135547e65e25 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] HTTP exception thrown: Instance acd1b630-d842-47ea-8019-f405c41ad7d3 could not be found. Aug 31 01:29:00.474872 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-b449c691-eb5a-44f0-96f2-135547e65e25 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Request method failure captured: Aug 31 01:29:00.474872 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: request: GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3 HTTP/1.1 Aug 31 01:29:00.474872 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept: application/json Aug 31 01:29:00.474872 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept-Encoding: identity Aug 31 01:29:00.474872 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Connection: close Aug 31 01:29:00.474872 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Length: 0 Aug 31 01:29:00.474872 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Type: application/json Aug 31 01:29:00.474872 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Host: 10.222.0.20 Aug 31 01:29:00.474872 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Openstack-System-Scope: None Aug 31 01:29:00.474872 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: User-Agent: python-urllib3/1.26.12 Aug 31 01:29:00.474872 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Auth-Token: gAAAAABjDrfet2Sy4N8jKKJoN7i8trLl0KW7DYiW5JhaLj0L5xpx8IJJDKjwB1T51gnweVtzcKX7Vmb1NaayoFFPtTaITD4WxtfyhSUUM3_4_aZ5GptnzhJmrFo6ZwSNdxq7_gCewRQsJwS99WXQ3X8vSLGTrSznkbNFB8yNJvuQw_w6CXmffXc Aug 31 01:29:00.474872 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Id: None Aug 31 01:29:00.474872 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Name: None Aug 31 01:29:00.474872 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Identity-Status: Confirmed Aug 31 01:29:00.474872 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Is-Admin-Project: True Aug 31 01:29:00.474872 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Id: default Aug 31 01:29:00.474872 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Name: Default Aug 31 01:29:00.474872 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Id: 164da7d4776d4e9f8cf6497aa784d312 Aug 31 01:29:00.474872 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Name: tempest-AttachVolumeNegativeTest-1582720348 Aug 31 01:29:00.474872 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Role: member,reader Aug 31 01:29:00.474872 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Roles: member,reader Aug 31 01:29:00.476632 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/164da7d4776d4e9f8cf6497aa784d312"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_164da7d4776d4e9f8cf6497aa784d312", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/164da7d4776d4e9f8cf6497aa784d312"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/164da7d4776d4e9f8cf6497aa784d312"}]}] Aug 31 01:29:00.476632 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant: tempest-AttachVolumeNegativeTest-1582720348 Aug 31 01:29:00.476632 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Id: 164da7d4776d4e9f8cf6497aa784d312 Aug 31 01:29:00.476632 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1582720348 Aug 31 01:29:00.476632 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User: tempest-AttachVolumeNegativeTest-1582720348-project Aug 31 01:29:00.476632 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Id: default Aug 31 01:29:00.476632 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Name: Default Aug 31 01:29:00.476632 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Id: 52ed99737fd240789bb682fd9bf11be3 Aug 31 01:29:00.476632 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Name: tempest-AttachVolumeNegativeTest-1582720348-project Aug 31 01:29:00.476632 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: method: > Aug 31 01:29:00.476632 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: exception: Instance acd1b630-d842-47ea-8019-f405c41ad7d3 could not be found. Aug 31 01:29:00.476632 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: action_args: {'id': 'acd1b630-d842-47ea-8019-f405c41ad7d3'} Aug 31 01:29:00.477540 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:29:00.477540 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:00.477540 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:29:00.477540 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:29:00.477540 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:29:00.477540 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:29:00.477540 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:29:00.477540 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:29:00.477540 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:29:00.477540 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:29:00.477540 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acd1b630-d842-47ea-8019-f405c41ad7d3 could not be found. Aug 31 01:29:00.477540 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:00.477540 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:00.477540 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:00.477540 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:00.477540 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:00.477540 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:00.477540 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:29:00.477540 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:29:00.477540 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:29:00.479106 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:29:00.479106 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:29:00.479106 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:29:00.479106 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:29:00.479106 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:29:00.479106 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:29:00.479106 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:29:00.479106 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acd1b630-d842-47ea-8019-f405c41ad7d3 could not be found. Aug 31 01:29:00.479106 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:00.479106 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:00.479106 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:00.479106 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:00.479106 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:00.479106 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:00.479106 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:29:00.479106 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:29:00.479106 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acd1b630-d842-47ea-8019-f405c41ad7d3 could not be found. Aug 31 01:29:00.479106 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:00.480544 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-b449c691-eb5a-44f0-96f2-135547e65e25 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Returning 404 to user: Instance acd1b630-d842-47ea-8019-f405c41ad7d3 could not be found. {{(pid=121025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:29:00.480544 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-b449c691-eb5a-44f0-96f2-135547e65e25 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3" status: 404 len: 111 microversion: 2.1 time: 0.030045 Aug 31 01:29:00.480544 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 383/759] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:29:00 2022] GET /compute/v2.1/servers/acd1b630-d842-47ea-8019-f405c41ad7d3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:29:00.485090 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-278b20a5-ac54-43f7-a787-ede34a016274 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:00.485581 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-278b20a5-ac54-43f7-a787-ede34a016274 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 082d7637-9b1c-469c-b688-c76ca61e9f6b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:00.492105 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-278b20a5-ac54-43f7-a787-ede34a016274 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:00.492589 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-278b20a5-ac54-43f7-a787-ede34a016274 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:00.493053 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-278b20a5-ac54-43f7-a787-ede34a016274 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:00.493743 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-278b20a5-ac54-43f7-a787-ede34a016274 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:00.494200 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-278b20a5-ac54-43f7-a787-ede34a016274 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:00.494633 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-278b20a5-ac54-43f7-a787-ede34a016274 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:00.507732 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.wsgi [None req-278b20a5-ac54-43f7-a787-ede34a016274 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] HTTP exception thrown: Instance 082d7637-9b1c-469c-b688-c76ca61e9f6b could not be found. Aug 31 01:29:00.509276 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-278b20a5-ac54-43f7-a787-ede34a016274 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Request method failure captured: Aug 31 01:29:00.509276 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: request: DELETE /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b HTTP/1.1 Aug 31 01:29:00.509276 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept: application/json Aug 31 01:29:00.509276 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept-Encoding: identity Aug 31 01:29:00.509276 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Connection: close Aug 31 01:29:00.509276 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Length: 0 Aug 31 01:29:00.509276 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Type: application/json Aug 31 01:29:00.509276 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Host: 10.222.0.20 Aug 31 01:29:00.509276 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Openstack-System-Scope: None Aug 31 01:29:00.509276 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: User-Agent: python-urllib3/1.26.12 Aug 31 01:29:00.509276 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Auth-Token: gAAAAABjDrfet2Sy4N8jKKJoN7i8trLl0KW7DYiW5JhaLj0L5xpx8IJJDKjwB1T51gnweVtzcKX7Vmb1NaayoFFPtTaITD4WxtfyhSUUM3_4_aZ5GptnzhJmrFo6ZwSNdxq7_gCewRQsJwS99WXQ3X8vSLGTrSznkbNFB8yNJvuQw_w6CXmffXc Aug 31 01:29:00.509276 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Id: None Aug 31 01:29:00.509276 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Name: None Aug 31 01:29:00.509276 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Identity-Status: Confirmed Aug 31 01:29:00.509276 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Is-Admin-Project: True Aug 31 01:29:00.509276 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Id: default Aug 31 01:29:00.509276 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Name: Default Aug 31 01:29:00.509276 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Id: 164da7d4776d4e9f8cf6497aa784d312 Aug 31 01:29:00.509276 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Name: tempest-AttachVolumeNegativeTest-1582720348 Aug 31 01:29:00.509276 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Role: member,reader Aug 31 01:29:00.509276 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Roles: member,reader Aug 31 01:29:00.510711 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/164da7d4776d4e9f8cf6497aa784d312"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_164da7d4776d4e9f8cf6497aa784d312", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/164da7d4776d4e9f8cf6497aa784d312"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/164da7d4776d4e9f8cf6497aa784d312"}]}] Aug 31 01:29:00.510711 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant: tempest-AttachVolumeNegativeTest-1582720348 Aug 31 01:29:00.510711 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Id: 164da7d4776d4e9f8cf6497aa784d312 Aug 31 01:29:00.510711 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1582720348 Aug 31 01:29:00.510711 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User: tempest-AttachVolumeNegativeTest-1582720348-project Aug 31 01:29:00.510711 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Id: default Aug 31 01:29:00.510711 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Name: Default Aug 31 01:29:00.510711 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Id: 52ed99737fd240789bb682fd9bf11be3 Aug 31 01:29:00.510711 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Name: tempest-AttachVolumeNegativeTest-1582720348-project Aug 31 01:29:00.510711 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: method: > Aug 31 01:29:00.510711 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: exception: Instance 082d7637-9b1c-469c-b688-c76ca61e9f6b could not be found. Aug 31 01:29:00.510711 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: action_args: {'id': '082d7637-9b1c-469c-b688-c76ca61e9f6b'} Aug 31 01:29:00.511585 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:29:00.511585 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:00.511585 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:29:00.511585 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:29:00.511585 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:29:00.511585 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:29:00.511585 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:29:00.511585 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:29:00.511585 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:29:00.511585 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:29:00.511585 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 082d7637-9b1c-469c-b688-c76ca61e9f6b could not be found. Aug 31 01:29:00.511585 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:00.511585 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:00.511585 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:00.511585 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:00.511585 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:00.511585 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:00.511585 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:29:00.511585 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:29:00.511585 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:29:00.513325 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:29:00.513325 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 01:29:00.513325 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 01:29:00.513325 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 01:29:00.513325 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 01:29:00.513325 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:29:00.513325 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:29:00.513325 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:29:00.513325 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:29:00.513325 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 082d7637-9b1c-469c-b688-c76ca61e9f6b could not be found. Aug 31 01:29:00.513325 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:00.513325 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:00.513325 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:00.513325 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:00.513325 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:00.513325 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:00.513325 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:29:00.513325 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:29:00.513325 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 082d7637-9b1c-469c-b688-c76ca61e9f6b could not be found. Aug 31 01:29:00.513325 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:00.515098 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-278b20a5-ac54-43f7-a787-ede34a016274 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Returning 404 to user: Instance 082d7637-9b1c-469c-b688-c76ca61e9f6b could not be found. {{(pid=121025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:29:00.515098 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-278b20a5-ac54-43f7-a787-ede34a016274 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "DELETE /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b" status: 404 len: 111 microversion: 2.1 time: 0.029280 Aug 31 01:29:00.515098 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 384/760] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 01:29:00 2022] DELETE /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 01:29:00.518795 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-167672d8-9eaf-45d3-b2ec-7ecfff9d1718 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:00.519395 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-167672d8-9eaf-45d3-b2ec-7ecfff9d1718 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 082d7637-9b1c-469c-b688-c76ca61e9f6b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:00.524958 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-167672d8-9eaf-45d3-b2ec-7ecfff9d1718 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:00.528479 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-167672d8-9eaf-45d3-b2ec-7ecfff9d1718 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:00.528479 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-167672d8-9eaf-45d3-b2ec-7ecfff9d1718 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:00.528479 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-167672d8-9eaf-45d3-b2ec-7ecfff9d1718 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:00.528479 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-167672d8-9eaf-45d3-b2ec-7ecfff9d1718 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:00.528860 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-167672d8-9eaf-45d3-b2ec-7ecfff9d1718 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:00.540888 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.wsgi [None req-167672d8-9eaf-45d3-b2ec-7ecfff9d1718 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] HTTP exception thrown: Instance 082d7637-9b1c-469c-b688-c76ca61e9f6b could not be found. Aug 31 01:29:00.542372 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-167672d8-9eaf-45d3-b2ec-7ecfff9d1718 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Request method failure captured: Aug 31 01:29:00.542372 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: request: GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b HTTP/1.1 Aug 31 01:29:00.542372 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept: application/json Aug 31 01:29:00.542372 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept-Encoding: identity Aug 31 01:29:00.542372 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Connection: close Aug 31 01:29:00.542372 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Length: 0 Aug 31 01:29:00.542372 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Type: application/json Aug 31 01:29:00.542372 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Host: 10.222.0.20 Aug 31 01:29:00.542372 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Openstack-System-Scope: None Aug 31 01:29:00.542372 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: User-Agent: python-urllib3/1.26.12 Aug 31 01:29:00.542372 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Auth-Token: gAAAAABjDrfet2Sy4N8jKKJoN7i8trLl0KW7DYiW5JhaLj0L5xpx8IJJDKjwB1T51gnweVtzcKX7Vmb1NaayoFFPtTaITD4WxtfyhSUUM3_4_aZ5GptnzhJmrFo6ZwSNdxq7_gCewRQsJwS99WXQ3X8vSLGTrSznkbNFB8yNJvuQw_w6CXmffXc Aug 31 01:29:00.542372 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Id: None Aug 31 01:29:00.542372 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Name: None Aug 31 01:29:00.542372 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Identity-Status: Confirmed Aug 31 01:29:00.542372 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Is-Admin-Project: True Aug 31 01:29:00.542372 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Id: default Aug 31 01:29:00.542372 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Name: Default Aug 31 01:29:00.542372 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Id: 164da7d4776d4e9f8cf6497aa784d312 Aug 31 01:29:00.542372 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Name: tempest-AttachVolumeNegativeTest-1582720348 Aug 31 01:29:00.542372 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Role: member,reader Aug 31 01:29:00.542372 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Roles: member,reader Aug 31 01:29:00.543895 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/164da7d4776d4e9f8cf6497aa784d312"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_164da7d4776d4e9f8cf6497aa784d312", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/164da7d4776d4e9f8cf6497aa784d312"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/164da7d4776d4e9f8cf6497aa784d312"}]}] Aug 31 01:29:00.543895 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant: tempest-AttachVolumeNegativeTest-1582720348 Aug 31 01:29:00.543895 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Id: 164da7d4776d4e9f8cf6497aa784d312 Aug 31 01:29:00.543895 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1582720348 Aug 31 01:29:00.543895 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User: tempest-AttachVolumeNegativeTest-1582720348-project Aug 31 01:29:00.543895 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Id: default Aug 31 01:29:00.543895 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Name: Default Aug 31 01:29:00.543895 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Id: 52ed99737fd240789bb682fd9bf11be3 Aug 31 01:29:00.543895 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Name: tempest-AttachVolumeNegativeTest-1582720348-project Aug 31 01:29:00.543895 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: method: > Aug 31 01:29:00.543895 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: exception: Instance 082d7637-9b1c-469c-b688-c76ca61e9f6b could not be found. Aug 31 01:29:00.543895 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: action_args: {'id': '082d7637-9b1c-469c-b688-c76ca61e9f6b'} Aug 31 01:29:00.545063 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:29:00.545063 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:00.545063 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:29:00.545063 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:29:00.545063 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:29:00.545063 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:29:00.545063 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:29:00.545063 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:29:00.545063 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:29:00.545063 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:29:00.545063 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 082d7637-9b1c-469c-b688-c76ca61e9f6b could not be found. Aug 31 01:29:00.545063 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:00.545063 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:00.545063 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:00.545063 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:00.545063 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:00.545063 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:00.545063 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:29:00.545063 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:29:00.545063 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:29:00.546744 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:29:00.546744 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:29:00.546744 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:29:00.546744 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:29:00.546744 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:29:00.546744 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:29:00.546744 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:29:00.546744 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 082d7637-9b1c-469c-b688-c76ca61e9f6b could not be found. Aug 31 01:29:00.546744 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:00.546744 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:00.546744 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:00.546744 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:00.546744 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:00.546744 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:00.546744 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:29:00.546744 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:29:00.546744 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 082d7637-9b1c-469c-b688-c76ca61e9f6b could not be found. Aug 31 01:29:00.546744 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:00.548578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-167672d8-9eaf-45d3-b2ec-7ecfff9d1718 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Returning 404 to user: Instance 082d7637-9b1c-469c-b688-c76ca61e9f6b could not be found. {{(pid=121025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:29:00.548578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-167672d8-9eaf-45d3-b2ec-7ecfff9d1718 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b" status: 404 len: 111 microversion: 2.1 time: 0.028469 Aug 31 01:29:00.548578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 385/761] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:29:00 2022] GET /compute/v2.1/servers/082d7637-9b1c-469c-b688-c76ca61e9f6b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 01:29:00.965107 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-3df82581-3e59-4ffc-a7e5-8e367f5e9bbc tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "POST /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.067114 Aug 31 01:29:00.965886 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 377/762] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 31 01:28:59 2022] POST /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d/os-volume_attachments => generated 194 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:29:01.131005 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-f28a6140-2d56-4fcb-a1dc-02cf4284f008 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:01.133182 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-f28a6140-2d56-4fcb-a1dc-02cf4284f008 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: f29a15ea-aad6-4491-a2e4-602f9ee66899] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:01.139066 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f28a6140-2d56-4fcb-a1dc-02cf4284f008 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:01.140165 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f28a6140-2d56-4fcb-a1dc-02cf4284f008 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:01.140165 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f28a6140-2d56-4fcb-a1dc-02cf4284f008 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:01.140603 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f28a6140-2d56-4fcb-a1dc-02cf4284f008 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:01.141082 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f28a6140-2d56-4fcb-a1dc-02cf4284f008 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:01.141496 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f28a6140-2d56-4fcb-a1dc-02cf4284f008 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:01.198676 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-f28a6140-2d56-4fcb-a1dc-02cf4284f008 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044744 Aug 31 01:29:01.198676 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 386/763] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 01:29:01 2022] GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:29:01.322864 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-0a9d1ed3-7d37-4efe-9e22-128e3d9b9150 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:01.323443 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-0a9d1ed3-7d37-4efe-9e22-128e3d9b9150 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: f29a15ea-aad6-4491-a2e4-602f9ee66899] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:01.329923 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0a9d1ed3-7d37-4efe-9e22-128e3d9b9150 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:01.330416 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0a9d1ed3-7d37-4efe-9e22-128e3d9b9150 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:01.330852 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0a9d1ed3-7d37-4efe-9e22-128e3d9b9150 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:01.331559 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0a9d1ed3-7d37-4efe-9e22-128e3d9b9150 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:01.332046 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0a9d1ed3-7d37-4efe-9e22-128e3d9b9150 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:01.332475 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0a9d1ed3-7d37-4efe-9e22-128e3d9b9150 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:01.360937 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-0a9d1ed3-7d37-4efe-9e22-128e3d9b9150 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899/os-volume_attachments/f2d910a2-253e-43ec-9c04-d723f7d4f649" status: 200 len: 194 microversion: 2.1 time: 0.042513 Aug 31 01:29:01.361509 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 378/764] 10.222.0.20 () {58 vars in 1413 bytes} [Wed Aug 31 01:29:01 2022] GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899/os-volume_attachments/f2d910a2-253e-43ec-9c04-d723f7d4f649 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:29:01.372479 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-36886526-58a5-49be-b575-3c3e250e1626 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:01.373015 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-36886526-58a5-49be-b575-3c3e250e1626 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: f29a15ea-aad6-4491-a2e4-602f9ee66899] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:01.379124 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-36886526-58a5-49be-b575-3c3e250e1626 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:01.379606 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-36886526-58a5-49be-b575-3c3e250e1626 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:01.380039 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-36886526-58a5-49be-b575-3c3e250e1626 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:01.380748 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-36886526-58a5-49be-b575-3c3e250e1626 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:01.381284 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-36886526-58a5-49be-b575-3c3e250e1626 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:01.381760 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-36886526-58a5-49be-b575-3c3e250e1626 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:01.462680 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.objects.instance [None req-36886526-58a5-49be-b575-3c3e250e1626 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lazy-loading 'services' on Instance uuid f29a15ea-aad6-4491-a2e4-602f9ee66899 {{(pid=121025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:29:01.709548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-36886526-58a5-49be-b575-3c3e250e1626 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899/os-volume_attachments/f2d910a2-253e-43ec-9c04-d723f7d4f649" status: 202 len: 0 microversion: 2.1 time: 0.340814 Aug 31 01:29:01.710159 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 387/765] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 31 01:29:01 2022] DELETE /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899/os-volume_attachments/f2d910a2-253e-43ec-9c04-d723f7d4f649 => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 01:29:01.961518 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-fa825a1b-9595-498f-a153-68b771f633ec tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:01.961966 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-fa825a1b-9595-498f-a153-68b771f633ec tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 8ce564c8-7a17-4de1-96b9-3737fca73840] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:01.967882 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fa825a1b-9595-498f-a153-68b771f633ec tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:01.968486 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fa825a1b-9595-498f-a153-68b771f633ec tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:01.968826 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fa825a1b-9595-498f-a153-68b771f633ec tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:01.969514 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fa825a1b-9595-498f-a153-68b771f633ec tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:01.969971 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fa825a1b-9595-498f-a153-68b771f633ec tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:01.970395 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-fa825a1b-9595-498f-a153-68b771f633ec tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:01.983696 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.wsgi [None req-fa825a1b-9595-498f-a153-68b771f633ec tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] HTTP exception thrown: Instance 8ce564c8-7a17-4de1-96b9-3737fca73840 could not be found. Aug 31 01:29:01.985355 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-fa825a1b-9595-498f-a153-68b771f633ec tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Request method failure captured: Aug 31 01:29:01.985355 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: request: DELETE /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840 HTTP/1.1 Aug 31 01:29:01.985355 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept: application/json Aug 31 01:29:01.985355 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept-Encoding: identity Aug 31 01:29:01.985355 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Connection: close Aug 31 01:29:01.985355 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Length: 0 Aug 31 01:29:01.985355 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Type: application/json Aug 31 01:29:01.985355 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Host: 10.222.0.20 Aug 31 01:29:01.985355 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Openstack-System-Scope: None Aug 31 01:29:01.985355 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: User-Agent: python-urllib3/1.26.12 Aug 31 01:29:01.985355 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Auth-Token: gAAAAABjDrfet2Sy4N8jKKJoN7i8trLl0KW7DYiW5JhaLj0L5xpx8IJJDKjwB1T51gnweVtzcKX7Vmb1NaayoFFPtTaITD4WxtfyhSUUM3_4_aZ5GptnzhJmrFo6ZwSNdxq7_gCewRQsJwS99WXQ3X8vSLGTrSznkbNFB8yNJvuQw_w6CXmffXc Aug 31 01:29:01.985355 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Id: None Aug 31 01:29:01.985355 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Name: None Aug 31 01:29:01.985355 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Identity-Status: Confirmed Aug 31 01:29:01.985355 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Is-Admin-Project: True Aug 31 01:29:01.985355 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Id: default Aug 31 01:29:01.985355 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Name: Default Aug 31 01:29:01.985355 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Id: 164da7d4776d4e9f8cf6497aa784d312 Aug 31 01:29:01.985355 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Name: tempest-AttachVolumeNegativeTest-1582720348 Aug 31 01:29:01.985355 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Role: member,reader Aug 31 01:29:01.985355 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Roles: member,reader Aug 31 01:29:01.986880 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/164da7d4776d4e9f8cf6497aa784d312"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_164da7d4776d4e9f8cf6497aa784d312", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/164da7d4776d4e9f8cf6497aa784d312"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/164da7d4776d4e9f8cf6497aa784d312"}]}] Aug 31 01:29:01.986880 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant: tempest-AttachVolumeNegativeTest-1582720348 Aug 31 01:29:01.986880 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Id: 164da7d4776d4e9f8cf6497aa784d312 Aug 31 01:29:01.986880 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1582720348 Aug 31 01:29:01.986880 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User: tempest-AttachVolumeNegativeTest-1582720348-project Aug 31 01:29:01.986880 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Id: default Aug 31 01:29:01.986880 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Name: Default Aug 31 01:29:01.986880 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Id: 52ed99737fd240789bb682fd9bf11be3 Aug 31 01:29:01.986880 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Name: tempest-AttachVolumeNegativeTest-1582720348-project Aug 31 01:29:01.986880 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: method: > Aug 31 01:29:01.986880 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: exception: Instance 8ce564c8-7a17-4de1-96b9-3737fca73840 could not be found. Aug 31 01:29:01.986880 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: action_args: {'id': '8ce564c8-7a17-4de1-96b9-3737fca73840'} Aug 31 01:29:01.987901 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:29:01.987901 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:01.987901 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:29:01.987901 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:29:01.987901 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:29:01.987901 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:29:01.987901 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:29:01.987901 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:29:01.987901 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:29:01.987901 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:29:01.987901 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ce564c8-7a17-4de1-96b9-3737fca73840 could not be found. Aug 31 01:29:01.987901 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:01.987901 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:01.987901 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:01.987901 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:01.987901 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:01.987901 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:01.987901 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:29:01.987901 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:29:01.987901 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:29:01.989375 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:29:01.989375 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 01:29:01.989375 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 01:29:01.989375 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 01:29:01.989375 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 01:29:01.989375 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:29:01.989375 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:29:01.989375 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:29:01.989375 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:29:01.989375 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ce564c8-7a17-4de1-96b9-3737fca73840 could not be found. Aug 31 01:29:01.989375 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:01.989375 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:01.989375 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:01.989375 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:01.989375 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:01.989375 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:01.989375 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:29:01.989375 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:29:01.989375 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ce564c8-7a17-4de1-96b9-3737fca73840 could not be found. Aug 31 01:29:01.989375 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:01.991477 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-fa825a1b-9595-498f-a153-68b771f633ec tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Returning 404 to user: Instance 8ce564c8-7a17-4de1-96b9-3737fca73840 could not be found. {{(pid=121026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:29:01.991477 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-fa825a1b-9595-498f-a153-68b771f633ec tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840" status: 404 len: 111 microversion: 2.1 time: 0.029237 Aug 31 01:29:01.991477 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 379/766] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 01:29:01 2022] DELETE /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:29:01.996038 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-f26063f4-f265-411e-88ed-ac63b55d23d6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:01.996770 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-f26063f4-f265-411e-88ed-ac63b55d23d6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] [instance: 8ce564c8-7a17-4de1-96b9-3737fca73840] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:02.002923 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f26063f4-f265-411e-88ed-ac63b55d23d6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:02.003407 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f26063f4-f265-411e-88ed-ac63b55d23d6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:02.003841 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f26063f4-f265-411e-88ed-ac63b55d23d6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:02.004528 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f26063f4-f265-411e-88ed-ac63b55d23d6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:02.005018 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f26063f4-f265-411e-88ed-ac63b55d23d6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:02.005442 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f26063f4-f265-411e-88ed-ac63b55d23d6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:02.019214 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.wsgi [None req-f26063f4-f265-411e-88ed-ac63b55d23d6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] HTTP exception thrown: Instance 8ce564c8-7a17-4de1-96b9-3737fca73840 could not be found. Aug 31 01:29:02.020891 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-f26063f4-f265-411e-88ed-ac63b55d23d6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Request method failure captured: Aug 31 01:29:02.020891 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: request: GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840 HTTP/1.1 Aug 31 01:29:02.020891 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept: application/json Aug 31 01:29:02.020891 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept-Encoding: identity Aug 31 01:29:02.020891 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Connection: close Aug 31 01:29:02.020891 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Length: 0 Aug 31 01:29:02.020891 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Type: application/json Aug 31 01:29:02.020891 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Host: 10.222.0.20 Aug 31 01:29:02.020891 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Openstack-System-Scope: None Aug 31 01:29:02.020891 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: User-Agent: python-urllib3/1.26.12 Aug 31 01:29:02.020891 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Auth-Token: gAAAAABjDrfet2Sy4N8jKKJoN7i8trLl0KW7DYiW5JhaLj0L5xpx8IJJDKjwB1T51gnweVtzcKX7Vmb1NaayoFFPtTaITD4WxtfyhSUUM3_4_aZ5GptnzhJmrFo6ZwSNdxq7_gCewRQsJwS99WXQ3X8vSLGTrSznkbNFB8yNJvuQw_w6CXmffXc Aug 31 01:29:02.020891 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Id: None Aug 31 01:29:02.020891 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Name: None Aug 31 01:29:02.020891 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Identity-Status: Confirmed Aug 31 01:29:02.020891 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Is-Admin-Project: True Aug 31 01:29:02.020891 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Id: default Aug 31 01:29:02.020891 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Name: Default Aug 31 01:29:02.020891 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Id: 164da7d4776d4e9f8cf6497aa784d312 Aug 31 01:29:02.020891 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Name: tempest-AttachVolumeNegativeTest-1582720348 Aug 31 01:29:02.020891 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Role: member,reader Aug 31 01:29:02.020891 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Roles: member,reader Aug 31 01:29:02.022524 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/164da7d4776d4e9f8cf6497aa784d312"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_164da7d4776d4e9f8cf6497aa784d312", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/164da7d4776d4e9f8cf6497aa784d312"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/164da7d4776d4e9f8cf6497aa784d312"}]}] Aug 31 01:29:02.022524 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant: tempest-AttachVolumeNegativeTest-1582720348 Aug 31 01:29:02.022524 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Id: 164da7d4776d4e9f8cf6497aa784d312 Aug 31 01:29:02.022524 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1582720348 Aug 31 01:29:02.022524 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User: tempest-AttachVolumeNegativeTest-1582720348-project Aug 31 01:29:02.022524 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Id: default Aug 31 01:29:02.022524 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Name: Default Aug 31 01:29:02.022524 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Id: 52ed99737fd240789bb682fd9bf11be3 Aug 31 01:29:02.022524 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Name: tempest-AttachVolumeNegativeTest-1582720348-project Aug 31 01:29:02.022524 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: method: > Aug 31 01:29:02.022524 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: exception: Instance 8ce564c8-7a17-4de1-96b9-3737fca73840 could not be found. Aug 31 01:29:02.022524 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: action_args: {'id': '8ce564c8-7a17-4de1-96b9-3737fca73840'} Aug 31 01:29:02.023487 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:29:02.023487 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:02.023487 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:29:02.023487 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:29:02.023487 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:29:02.023487 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:29:02.023487 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:29:02.023487 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:29:02.023487 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:29:02.023487 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:29:02.023487 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ce564c8-7a17-4de1-96b9-3737fca73840 could not be found. Aug 31 01:29:02.023487 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:02.023487 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:02.023487 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:02.023487 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:02.023487 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:02.023487 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:02.023487 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:29:02.023487 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:29:02.023487 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:29:02.025024 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:29:02.025024 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:29:02.025024 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:29:02.025024 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:29:02.025024 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:29:02.025024 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:29:02.025024 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:29:02.025024 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ce564c8-7a17-4de1-96b9-3737fca73840 could not be found. Aug 31 01:29:02.025024 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:02.025024 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:02.025024 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:02.025024 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:02.025024 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:02.025024 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:02.025024 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:29:02.025024 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:29:02.025024 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ce564c8-7a17-4de1-96b9-3737fca73840 could not be found. Aug 31 01:29:02.025024 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:02.026318 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-f26063f4-f265-411e-88ed-ac63b55d23d6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] Returning 404 to user: Instance 8ce564c8-7a17-4de1-96b9-3737fca73840 could not be found. {{(pid=121025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:29:02.026318 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-f26063f4-f265-411e-88ed-ac63b55d23d6 tempest-AttachVolumeNegativeTest-1582720348 tempest-AttachVolumeNegativeTest-1582720348-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840" status: 404 len: 111 microversion: 2.1 time: 0.030405 Aug 31 01:29:02.026318 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 388/767] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:29:01 2022] GET /compute/v2.1/servers/8ce564c8-7a17-4de1-96b9-3737fca73840 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:29:07.527198 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell0:SELECT=2 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:29:07.634405 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-12eb5699-910a-4f09-8346-5cca3b0df434 tempest-VolumesNegativeTest-793796632 tempest-VolumesNegativeTest-793796632-project] Action: 'create', calling method: .version_select at 0x7f1fe1708d30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1198509851", "metadata": {"Type": "work"}}} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:29:07.641218 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-12eb5699-910a-4f09-8346-5cca3b0df434 tempest-VolumesNegativeTest-793796632 tempest-VolumesNegativeTest-793796632-project] Request method failure captured: Aug 31 01:29:07.641218 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 01:29:07.641218 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept: application/json Aug 31 01:29:07.641218 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept-Encoding: identity Aug 31 01:29:07.641218 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Connection: close Aug 31 01:29:07.641218 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Length: 122 Aug 31 01:29:07.641218 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Type: application/json Aug 31 01:29:07.641218 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Host: 10.222.0.20 Aug 31 01:29:07.641218 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Openstack-System-Scope: None Aug 31 01:29:07.641218 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: User-Agent: python-urllib3/1.26.12 Aug 31 01:29:07.641218 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Auth-Token: gAAAAABjDrlj_XERdle0Q-pOAsMP4wfSkTGVpw4tT9d0W15e7TrUZNRNUbTJItUcN3FceTbyJik8W0smt-KzpAWv9J7Gt-BAgECltpSnv-wVtnrU-2DCtV8dESmsU2nYjHbBbwRf1gHYe3SUmJto17hZOcFEzUJmzCzv1TKUFTiMOB-zCRVEiZQ Aug 31 01:29:07.641218 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Id: None Aug 31 01:29:07.641218 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Name: None Aug 31 01:29:07.641218 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Identity-Status: Confirmed Aug 31 01:29:07.641218 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Is-Admin-Project: True Aug 31 01:29:07.641218 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Id: default Aug 31 01:29:07.641218 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Name: Default Aug 31 01:29:07.641218 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Id: ed11221969d14b2bb6ba403dd9c412a1 Aug 31 01:29:07.641218 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Name: tempest-VolumesNegativeTest-793796632 Aug 31 01:29:07.641218 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Role: member,reader Aug 31 01:29:07.641218 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Roles: member,reader Aug 31 01:29:07.642823 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ed11221969d14b2bb6ba403dd9c412a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ed11221969d14b2bb6ba403dd9c412a1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ed11221969d14b2bb6ba403dd9c412a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ed11221969d14b2bb6ba403dd9c412a1"}]}] Aug 31 01:29:07.642823 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant: tempest-VolumesNegativeTest-793796632 Aug 31 01:29:07.642823 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Id: ed11221969d14b2bb6ba403dd9c412a1 Aug 31 01:29:07.642823 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Name: tempest-VolumesNegativeTest-793796632 Aug 31 01:29:07.642823 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User: tempest-VolumesNegativeTest-793796632-project Aug 31 01:29:07.642823 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Id: default Aug 31 01:29:07.642823 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Name: Default Aug 31 01:29:07.642823 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Id: 66b52863c45b42dda4dad08e3b809ad0 Aug 31 01:29:07.642823 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Name: tempest-VolumesNegativeTest-793796632-project Aug 31 01:29:07.642823 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Aug 31 01:29:07.642823 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1198509851", "metadata": {"Type": "work"}}} Aug 31 01:29:07.642823 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: method: Aug 31 01:29:07.642823 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 01:29:07.644042 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1198509851', 'metadata': {'Type': 'work'}}}} Aug 31 01:29:07.644042 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:29:07.644042 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:07.644042 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 01:29:07.644042 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 01:29:07.644042 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 01:29:07.644042 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise error Aug 31 01:29:07.644042 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 31 01:29:07.644042 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:07.644042 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 01:29:07.644042 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 01:29:07.644042 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:07.644042 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 01:29:07.644042 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi '#$%' Aug 31 01:29:07.644042 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:07.644042 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:07.644042 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:07.644042 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:07.644042 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:07.644042 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:07.644042 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:29:07.644042 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:29:07.646179 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 01:29:07.646179 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 01:29:07.646179 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:29:07.646179 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:29:07.646179 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 01:29:07.646179 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 01:29:07.646179 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 01:29:07.646179 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 01:29:07.646179 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 01:29:07.646179 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 01:29:07.646179 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 01:29:07.646179 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:07.646179 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:07.646179 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:07.646179 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:07.646179 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:07.646179 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:07.646179 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 01:29:07.646179 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 01:29:07.647660 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 01:29:07.647660 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:07.647660 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-12eb5699-910a-4f09-8346-5cca3b0df434 tempest-VolumesNegativeTest-793796632 tempest-VolumesNegativeTest-793796632-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:29:07.647660 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-12eb5699-910a-4f09-8346-5cca3b0df434 tempest-VolumesNegativeTest-793796632 tempest-VolumesNegativeTest-793796632-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.120775 Aug 31 01:29:07.647660 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 380/768] 10.222.0.20 () {60 vars in 1156 bytes} [Wed Aug 31 01:29:07 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 122 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 01:29:07.652199 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-f6562d26-6db3-4c1e-9dbe-e57e741e8cb1 tempest-VolumesNegativeTest-793796632 tempest-VolumesNegativeTest-793796632-project] Action: 'create', calling method: .version_select at 0x7f1fe161b940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-775550871", "metadata": {"Type": "work"}}} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:29:07.656849 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-f6562d26-6db3-4c1e-9dbe-e57e741e8cb1 tempest-VolumesNegativeTest-793796632 tempest-VolumesNegativeTest-793796632-project] Request method failure captured: Aug 31 01:29:07.656849 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 01:29:07.656849 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept: application/json Aug 31 01:29:07.656849 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept-Encoding: identity Aug 31 01:29:07.656849 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Connection: close Aug 31 01:29:07.656849 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Length: 119 Aug 31 01:29:07.656849 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Type: application/json Aug 31 01:29:07.656849 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Host: 10.222.0.20 Aug 31 01:29:07.656849 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Openstack-System-Scope: None Aug 31 01:29:07.656849 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: User-Agent: python-urllib3/1.26.12 Aug 31 01:29:07.656849 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Auth-Token: gAAAAABjDrlj_XERdle0Q-pOAsMP4wfSkTGVpw4tT9d0W15e7TrUZNRNUbTJItUcN3FceTbyJik8W0smt-KzpAWv9J7Gt-BAgECltpSnv-wVtnrU-2DCtV8dESmsU2nYjHbBbwRf1gHYe3SUmJto17hZOcFEzUJmzCzv1TKUFTiMOB-zCRVEiZQ Aug 31 01:29:07.656849 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Id: None Aug 31 01:29:07.656849 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Name: None Aug 31 01:29:07.656849 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Identity-Status: Confirmed Aug 31 01:29:07.656849 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Is-Admin-Project: True Aug 31 01:29:07.656849 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Id: default Aug 31 01:29:07.656849 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Name: Default Aug 31 01:29:07.656849 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Id: ed11221969d14b2bb6ba403dd9c412a1 Aug 31 01:29:07.656849 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Name: tempest-VolumesNegativeTest-793796632 Aug 31 01:29:07.656849 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Role: member,reader Aug 31 01:29:07.656849 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Roles: member,reader Aug 31 01:29:07.658364 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ed11221969d14b2bb6ba403dd9c412a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ed11221969d14b2bb6ba403dd9c412a1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ed11221969d14b2bb6ba403dd9c412a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ed11221969d14b2bb6ba403dd9c412a1"}]}] Aug 31 01:29:07.658364 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant: tempest-VolumesNegativeTest-793796632 Aug 31 01:29:07.658364 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Id: ed11221969d14b2bb6ba403dd9c412a1 Aug 31 01:29:07.658364 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Name: tempest-VolumesNegativeTest-793796632 Aug 31 01:29:07.658364 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User: tempest-VolumesNegativeTest-793796632-project Aug 31 01:29:07.658364 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Id: default Aug 31 01:29:07.658364 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Name: Default Aug 31 01:29:07.658364 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Id: 66b52863c45b42dda4dad08e3b809ad0 Aug 31 01:29:07.658364 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Name: tempest-VolumesNegativeTest-793796632-project Aug 31 01:29:07.658364 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Aug 31 01:29:07.658364 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-775550871", "metadata": {"Type": "work"}}} Aug 31 01:29:07.658364 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: method: Aug 31 01:29:07.658364 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 01:29:07.659447 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-775550871', 'metadata': {'Type': 'work'}}}} Aug 31 01:29:07.659447 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:29:07.659447 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:07.659447 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 01:29:07.659447 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 01:29:07.659447 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 01:29:07.659447 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise error Aug 31 01:29:07.659447 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 31 01:29:07.659447 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:07.659447 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 31 01:29:07.659447 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 01:29:07.659447 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:07.659447 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 01:29:07.659447 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi '0' Aug 31 01:29:07.659447 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:07.659447 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:07.659447 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:07.659447 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:07.659447 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:07.659447 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:07.659447 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:29:07.659447 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:29:07.661025 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 01:29:07.661025 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 01:29:07.661025 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:29:07.661025 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:29:07.661025 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 01:29:07.661025 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 01:29:07.661025 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 01:29:07.661025 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 01:29:07.661025 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 01:29:07.661025 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 01:29:07.661025 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 01:29:07.661025 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:07.661025 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:07.661025 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:07.661025 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:07.661025 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:07.661025 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:07.661025 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 01:29:07.661025 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 01:29:07.662510 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 01:29:07.662510 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:07.662510 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-f6562d26-6db3-4c1e-9dbe-e57e741e8cb1 tempest-VolumesNegativeTest-793796632 tempest-VolumesNegativeTest-793796632-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:29:07.662510 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-f6562d26-6db3-4c1e-9dbe-e57e741e8cb1 tempest-VolumesNegativeTest-793796632 tempest-VolumesNegativeTest-793796632-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009873 Aug 31 01:29:07.662510 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 389/769] 10.222.0.20 () {60 vars in 1156 bytes} [Wed Aug 31 01:29:07 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 31 01:29:07.667605 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-9ba5baa6-f259-4e8c-baf3-97ac1d2ae41b tempest-VolumesNegativeTest-793796632 tempest-VolumesNegativeTest-793796632-project] Action: 'create', calling method: .version_select at 0x7f1fe16d63a0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-785269870", "metadata": {"Type": "work"}}} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:29:07.672158 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-9ba5baa6-f259-4e8c-baf3-97ac1d2ae41b tempest-VolumesNegativeTest-793796632 tempest-VolumesNegativeTest-793796632-project] Request method failure captured: Aug 31 01:29:07.672158 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 01:29:07.672158 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept: application/json Aug 31 01:29:07.672158 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept-Encoding: identity Aug 31 01:29:07.672158 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Connection: close Aug 31 01:29:07.672158 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Length: 118 Aug 31 01:29:07.672158 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Type: application/json Aug 31 01:29:07.672158 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Host: 10.222.0.20 Aug 31 01:29:07.672158 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Openstack-System-Scope: None Aug 31 01:29:07.672158 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: User-Agent: python-urllib3/1.26.12 Aug 31 01:29:07.672158 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Auth-Token: gAAAAABjDrlj_XERdle0Q-pOAsMP4wfSkTGVpw4tT9d0W15e7TrUZNRNUbTJItUcN3FceTbyJik8W0smt-KzpAWv9J7Gt-BAgECltpSnv-wVtnrU-2DCtV8dESmsU2nYjHbBbwRf1gHYe3SUmJto17hZOcFEzUJmzCzv1TKUFTiMOB-zCRVEiZQ Aug 31 01:29:07.672158 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Id: None Aug 31 01:29:07.672158 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Name: None Aug 31 01:29:07.672158 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Identity-Status: Confirmed Aug 31 01:29:07.672158 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Is-Admin-Project: True Aug 31 01:29:07.672158 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Id: default Aug 31 01:29:07.672158 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Name: Default Aug 31 01:29:07.672158 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Id: ed11221969d14b2bb6ba403dd9c412a1 Aug 31 01:29:07.672158 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Name: tempest-VolumesNegativeTest-793796632 Aug 31 01:29:07.672158 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Role: member,reader Aug 31 01:29:07.672158 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Roles: member,reader Aug 31 01:29:07.673700 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ed11221969d14b2bb6ba403dd9c412a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ed11221969d14b2bb6ba403dd9c412a1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ed11221969d14b2bb6ba403dd9c412a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ed11221969d14b2bb6ba403dd9c412a1"}]}] Aug 31 01:29:07.673700 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant: tempest-VolumesNegativeTest-793796632 Aug 31 01:29:07.673700 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Id: ed11221969d14b2bb6ba403dd9c412a1 Aug 31 01:29:07.673700 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Name: tempest-VolumesNegativeTest-793796632 Aug 31 01:29:07.673700 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User: tempest-VolumesNegativeTest-793796632-project Aug 31 01:29:07.673700 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Id: default Aug 31 01:29:07.673700 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Name: Default Aug 31 01:29:07.673700 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Id: 66b52863c45b42dda4dad08e3b809ad0 Aug 31 01:29:07.673700 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Name: tempest-VolumesNegativeTest-793796632-project Aug 31 01:29:07.673700 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Aug 31 01:29:07.673700 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-785269870", "metadata": {"Type": "work"}}} Aug 31 01:29:07.673700 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: method: Aug 31 01:29:07.673700 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 01:29:07.674864 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-785269870', 'metadata': {'Type': 'work'}}}} Aug 31 01:29:07.674864 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:29:07.674864 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:07.674864 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 01:29:07.674864 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 01:29:07.674864 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 01:29:07.674864 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise error Aug 31 01:29:07.674864 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 31 01:29:07.674864 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:07.674864 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 01:29:07.674864 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 01:29:07.674864 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:07.674864 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 01:29:07.674864 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi '' Aug 31 01:29:07.674864 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:07.674864 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:07.674864 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:07.674864 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:07.674864 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:07.674864 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:07.674864 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:29:07.674864 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:29:07.676587 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 01:29:07.676587 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 01:29:07.676587 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:29:07.676587 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:29:07.676587 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 01:29:07.676587 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 01:29:07.676587 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 01:29:07.676587 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 01:29:07.676587 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 01:29:07.676587 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 01:29:07.676587 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 01:29:07.676587 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:07.676587 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:07.676587 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:07.676587 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:07.676587 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:07.676587 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:07.676587 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 01:29:07.676587 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 01:29:07.678768 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 01:29:07.678768 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:07.678768 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-9ba5baa6-f259-4e8c-baf3-97ac1d2ae41b tempest-VolumesNegativeTest-793796632 tempest-VolumesNegativeTest-793796632-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:29:07.678768 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-9ba5baa6-f259-4e8c-baf3-97ac1d2ae41b tempest-VolumesNegativeTest-793796632 tempest-VolumesNegativeTest-793796632-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009856 Aug 31 01:29:07.678768 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 381/770] 10.222.0.20 () {60 vars in 1156 bytes} [Wed Aug 31 01:29:07 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 01:29:07.684119 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-4836b993-b2e8-4265-90fe-9509587b3783 tempest-VolumesNegativeTest-793796632 tempest-VolumesNegativeTest-793796632-project] Calling method '.version_select at 0x7f1fe15814c0>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:07.713868 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.wsgi [None req-4836b993-b2e8-4265-90fe-9509587b3783 tempest-VolumesNegativeTest-793796632 tempest-VolumesNegativeTest-793796632-project] HTTP exception thrown: Volume tempest-invalid-2003763192 could not be found. Aug 31 01:29:07.715848 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-4836b993-b2e8-4265-90fe-9509587b3783 tempest-VolumesNegativeTest-793796632 tempest-VolumesNegativeTest-793796632-project] Request method failure captured: Aug 31 01:29:07.715848 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2003763192 HTTP/1.1 Aug 31 01:29:07.715848 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept: application/json Aug 31 01:29:07.715848 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept-Encoding: identity Aug 31 01:29:07.715848 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Connection: close Aug 31 01:29:07.715848 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Length: 0 Aug 31 01:29:07.715848 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Type: application/json Aug 31 01:29:07.715848 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Host: 10.222.0.20 Aug 31 01:29:07.715848 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Openstack-System-Scope: None Aug 31 01:29:07.715848 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: User-Agent: python-urllib3/1.26.12 Aug 31 01:29:07.715848 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Auth-Token: gAAAAABjDrlj_XERdle0Q-pOAsMP4wfSkTGVpw4tT9d0W15e7TrUZNRNUbTJItUcN3FceTbyJik8W0smt-KzpAWv9J7Gt-BAgECltpSnv-wVtnrU-2DCtV8dESmsU2nYjHbBbwRf1gHYe3SUmJto17hZOcFEzUJmzCzv1TKUFTiMOB-zCRVEiZQ Aug 31 01:29:07.715848 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Id: None Aug 31 01:29:07.715848 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Name: None Aug 31 01:29:07.715848 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Identity-Status: Confirmed Aug 31 01:29:07.715848 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Is-Admin-Project: True Aug 31 01:29:07.715848 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Id: default Aug 31 01:29:07.715848 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Name: Default Aug 31 01:29:07.715848 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Id: ed11221969d14b2bb6ba403dd9c412a1 Aug 31 01:29:07.715848 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Name: tempest-VolumesNegativeTest-793796632 Aug 31 01:29:07.715848 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Role: member,reader Aug 31 01:29:07.715848 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Roles: member,reader Aug 31 01:29:07.717376 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ed11221969d14b2bb6ba403dd9c412a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ed11221969d14b2bb6ba403dd9c412a1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ed11221969d14b2bb6ba403dd9c412a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ed11221969d14b2bb6ba403dd9c412a1"}]}] Aug 31 01:29:07.717376 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant: tempest-VolumesNegativeTest-793796632 Aug 31 01:29:07.717376 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Id: ed11221969d14b2bb6ba403dd9c412a1 Aug 31 01:29:07.717376 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Name: tempest-VolumesNegativeTest-793796632 Aug 31 01:29:07.717376 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User: tempest-VolumesNegativeTest-793796632-project Aug 31 01:29:07.717376 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Id: default Aug 31 01:29:07.717376 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Name: Default Aug 31 01:29:07.717376 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Id: 66b52863c45b42dda4dad08e3b809ad0 Aug 31 01:29:07.717376 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Name: tempest-VolumesNegativeTest-793796632-project Aug 31 01:29:07.717376 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: method: Aug 31 01:29:07.717376 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: exception: Volume tempest-invalid-2003763192 could not be found. Aug 31 01:29:07.717376 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: action_args: {'id': 'tempest-invalid-2003763192'} Aug 31 01:29:07.717376 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:29:07.718244 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:07.718244 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 01:29:07.718244 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 01:29:07.718244 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 01:29:07.718244 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 01:29:07.718244 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 01:29:07.718244 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 01:29:07.718244 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 01:29:07.718244 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 01:29:07.718244 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 01:29:07.718244 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 01:29:07.718244 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 01:29:07.718244 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 01:29:07.718244 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 01:29:07.718244 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 01:29:07.718244 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2003763192 could not be found. (HTTP 404) (Request-ID: req-db5a1c0c-1ca8-49d3-9f9c-202738baac21) Aug 31 01:29:07.718244 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:07.718244 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:07.718244 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:07.719618 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:07.719618 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 01:29:07.719618 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 01:29:07.719618 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 01:29:07.719618 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 01:29:07.719618 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 01:29:07.719618 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 01:29:07.719618 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 01:29:07.719618 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 01:29:07.719618 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 01:29:07.719618 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 01:29:07.719618 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 01:29:07.719618 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 01:29:07.719618 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 01:29:07.719618 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 01:29:07.719618 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 01:29:07.719618 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 01:29:07.719618 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 01:29:07.719618 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 01:29:07.721770 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 01:29:07.721770 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 01:29:07.721770 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 01:29:07.721770 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 01:29:07.721770 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2003763192 could not be found. Aug 31 01:29:07.721770 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:07.721770 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:07.721770 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:07.721770 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:07.721770 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:07.721770 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:07.721770 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:29:07.721770 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:29:07.721770 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 01:29:07.721770 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 01:29:07.721770 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:29:07.721770 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:29:07.721770 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 01:29:07.721770 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:29:07.721770 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2003763192 could not be found. Aug 31 01:29:07.723336 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:07.723336 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:07.723336 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:07.723336 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:07.723336 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:07.723336 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:07.723336 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:29:07.723336 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:29:07.723336 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2003763192 could not be found. Aug 31 01:29:07.723336 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:07.723336 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-4836b993-b2e8-4265-90fe-9509587b3783 tempest-VolumesNegativeTest-793796632 tempest-VolumesNegativeTest-793796632-project] Returning 404 to user: Volume tempest-invalid-2003763192 could not be found. {{(pid=121025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:29:07.723336 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-4836b993-b2e8-4265-90fe-9509587b3783 tempest-VolumesNegativeTest-793796632 tempest-VolumesNegativeTest-793796632-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2003763192" status: 404 len: 99 microversion: 2.1 time: 0.037842 Aug 31 01:29:07.723336 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 390/771] 10.222.0.20 () {58 vars in 1218 bytes} [Wed Aug 31 01:29:07 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2003763192 => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 01:29:07.727478 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-2407a07e-d2b2-49f5-8bd8-3fa312e2eb9c tempest-VolumesNegativeTest-793796632 tempest-VolumesNegativeTest-793796632-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003884 Aug 31 01:29:07.731261 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 382/772] 10.222.0.20 () {58 vars in 1140 bytes} [Wed Aug 31 01:29:07 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 31 01:29:07.738482 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-04fede64-6075-4559-9ff7-bfcfe1dfde4d tempest-VolumesNegativeTest-793796632 tempest-VolumesNegativeTest-793796632-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003735 Aug 31 01:29:07.738976 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 391/773] 10.222.0.20 () {58 vars in 1137 bytes} [Wed Aug 31 01:29:07 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 31 01:29:07.747749 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-d1fe73cc-55c7-4597-bfcb-f9ce4671cd11 tempest-VolumesNegativeTest-793796632 tempest-VolumesNegativeTest-793796632-project] Calling method '.version_select at 0x7f1fe1708670>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:07.776429 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.wsgi [None req-d1fe73cc-55c7-4597-bfcb-f9ce4671cd11 tempest-VolumesNegativeTest-793796632 tempest-VolumesNegativeTest-793796632-project] HTTP exception thrown: Volume 9d6f6e03-ec53-462e-a5c7-a69edc453f89 could not be found. Aug 31 01:29:07.778816 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-d1fe73cc-55c7-4597-bfcb-f9ce4671cd11 tempest-VolumesNegativeTest-793796632 tempest-VolumesNegativeTest-793796632-project] Request method failure captured: Aug 31 01:29:07.778816 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: request: DELETE /compute/v2.1/os-volumes/9d6f6e03-ec53-462e-a5c7-a69edc453f89 HTTP/1.1 Aug 31 01:29:07.778816 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept: application/json Aug 31 01:29:07.778816 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept-Encoding: identity Aug 31 01:29:07.778816 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Connection: close Aug 31 01:29:07.778816 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Length: 0 Aug 31 01:29:07.778816 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Type: application/json Aug 31 01:29:07.778816 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Host: 10.222.0.20 Aug 31 01:29:07.778816 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Openstack-System-Scope: None Aug 31 01:29:07.778816 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: User-Agent: python-urllib3/1.26.12 Aug 31 01:29:07.778816 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Auth-Token: gAAAAABjDrlj_XERdle0Q-pOAsMP4wfSkTGVpw4tT9d0W15e7TrUZNRNUbTJItUcN3FceTbyJik8W0smt-KzpAWv9J7Gt-BAgECltpSnv-wVtnrU-2DCtV8dESmsU2nYjHbBbwRf1gHYe3SUmJto17hZOcFEzUJmzCzv1TKUFTiMOB-zCRVEiZQ Aug 31 01:29:07.778816 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Id: None Aug 31 01:29:07.778816 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Name: None Aug 31 01:29:07.778816 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Identity-Status: Confirmed Aug 31 01:29:07.778816 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Is-Admin-Project: True Aug 31 01:29:07.778816 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Id: default Aug 31 01:29:07.778816 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Name: Default Aug 31 01:29:07.778816 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Id: ed11221969d14b2bb6ba403dd9c412a1 Aug 31 01:29:07.778816 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Name: tempest-VolumesNegativeTest-793796632 Aug 31 01:29:07.778816 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Role: member,reader Aug 31 01:29:07.778816 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Roles: member,reader Aug 31 01:29:07.780371 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ed11221969d14b2bb6ba403dd9c412a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ed11221969d14b2bb6ba403dd9c412a1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ed11221969d14b2bb6ba403dd9c412a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ed11221969d14b2bb6ba403dd9c412a1"}]}] Aug 31 01:29:07.780371 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant: tempest-VolumesNegativeTest-793796632 Aug 31 01:29:07.780371 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Id: ed11221969d14b2bb6ba403dd9c412a1 Aug 31 01:29:07.780371 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Name: tempest-VolumesNegativeTest-793796632 Aug 31 01:29:07.780371 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User: tempest-VolumesNegativeTest-793796632-project Aug 31 01:29:07.780371 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Id: default Aug 31 01:29:07.780371 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Name: Default Aug 31 01:29:07.780371 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Id: 66b52863c45b42dda4dad08e3b809ad0 Aug 31 01:29:07.780371 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Name: tempest-VolumesNegativeTest-793796632-project Aug 31 01:29:07.780371 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: method: Aug 31 01:29:07.780371 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: exception: Volume 9d6f6e03-ec53-462e-a5c7-a69edc453f89 could not be found. Aug 31 01:29:07.780371 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: action_args: {'id': '9d6f6e03-ec53-462e-a5c7-a69edc453f89'} Aug 31 01:29:07.780371 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:29:07.781384 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:07.781384 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 01:29:07.781384 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 01:29:07.781384 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 01:29:07.781384 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 01:29:07.781384 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 01:29:07.781384 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 01:29:07.781384 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 01:29:07.781384 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 01:29:07.781384 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 01:29:07.781384 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 01:29:07.781384 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 01:29:07.781384 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 01:29:07.781384 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 01:29:07.781384 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 01:29:07.781384 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9d6f6e03-ec53-462e-a5c7-a69edc453f89 could not be found. (HTTP 404) (Request-ID: req-14523cdb-0324-428a-99af-514d4a60c317) Aug 31 01:29:07.781384 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:07.781384 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:07.781384 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:07.782567 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:07.782567 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 01:29:07.782567 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 01:29:07.782567 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 01:29:07.782567 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 01:29:07.782567 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 01:29:07.782567 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 01:29:07.782567 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 01:29:07.782567 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 01:29:07.782567 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 01:29:07.782567 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 01:29:07.782567 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 01:29:07.782567 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 01:29:07.782567 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 01:29:07.782567 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 01:29:07.782567 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 01:29:07.782567 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 01:29:07.782567 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 01:29:07.782567 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 01:29:07.783666 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 01:29:07.783666 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 01:29:07.783666 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 01:29:07.783666 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 01:29:07.783666 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9d6f6e03-ec53-462e-a5c7-a69edc453f89 could not be found. Aug 31 01:29:07.783666 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:07.783666 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:07.783666 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:07.783666 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:07.783666 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:07.783666 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:07.783666 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:29:07.783666 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:29:07.783666 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 01:29:07.783666 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 01:29:07.783666 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:29:07.783666 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:29:07.783666 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 01:29:07.783666 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:29:07.785005 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9d6f6e03-ec53-462e-a5c7-a69edc453f89 could not be found. Aug 31 01:29:07.785005 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:07.785005 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:07.785005 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:07.785005 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:07.785005 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:07.785005 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:07.785005 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:29:07.785005 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:29:07.785005 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9d6f6e03-ec53-462e-a5c7-a69edc453f89 could not be found. Aug 31 01:29:07.785005 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:07.785005 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-d1fe73cc-55c7-4597-bfcb-f9ce4671cd11 tempest-VolumesNegativeTest-793796632 tempest-VolumesNegativeTest-793796632-project] Returning 404 to user: Volume 9d6f6e03-ec53-462e-a5c7-a69edc453f89 could not be found. {{(pid=121026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:29:07.785005 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-d1fe73cc-55c7-4597-bfcb-f9ce4671cd11 tempest-VolumesNegativeTest-793796632 tempest-VolumesNegativeTest-793796632-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/9d6f6e03-ec53-462e-a5c7-a69edc453f89" status: 404 len: 109 microversion: 2.1 time: 0.036217 Aug 31 01:29:07.785005 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 383/774] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Aug 31 01:29:07 2022] DELETE /compute/v2.1/os-volumes/9d6f6e03-ec53-462e-a5c7-a69edc453f89 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 01:29:07.790575 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-fecc57ff-3328-473e-97e7-2c1e7cd834bd tempest-VolumesNegativeTest-793796632 tempest-VolumesNegativeTest-793796632-project] Calling method '.version_select at 0x7f1fe17e1c10>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:07.818429 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.wsgi [None req-fecc57ff-3328-473e-97e7-2c1e7cd834bd tempest-VolumesNegativeTest-793796632 tempest-VolumesNegativeTest-793796632-project] HTTP exception thrown: Volume 09eaef61-f755-4e06-9a79-30907b6a074a could not be found. Aug 31 01:29:07.820360 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-fecc57ff-3328-473e-97e7-2c1e7cd834bd tempest-VolumesNegativeTest-793796632 tempest-VolumesNegativeTest-793796632-project] Request method failure captured: Aug 31 01:29:07.820360 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: request: GET /compute/v2.1/os-volumes/09eaef61-f755-4e06-9a79-30907b6a074a HTTP/1.1 Aug 31 01:29:07.820360 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept: application/json Aug 31 01:29:07.820360 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept-Encoding: identity Aug 31 01:29:07.820360 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Connection: close Aug 31 01:29:07.820360 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Length: 0 Aug 31 01:29:07.820360 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Type: application/json Aug 31 01:29:07.820360 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Host: 10.222.0.20 Aug 31 01:29:07.820360 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Openstack-System-Scope: None Aug 31 01:29:07.820360 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: User-Agent: python-urllib3/1.26.12 Aug 31 01:29:07.820360 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Auth-Token: gAAAAABjDrlj_XERdle0Q-pOAsMP4wfSkTGVpw4tT9d0W15e7TrUZNRNUbTJItUcN3FceTbyJik8W0smt-KzpAWv9J7Gt-BAgECltpSnv-wVtnrU-2DCtV8dESmsU2nYjHbBbwRf1gHYe3SUmJto17hZOcFEzUJmzCzv1TKUFTiMOB-zCRVEiZQ Aug 31 01:29:07.820360 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Id: None Aug 31 01:29:07.820360 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Name: None Aug 31 01:29:07.820360 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Identity-Status: Confirmed Aug 31 01:29:07.820360 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Is-Admin-Project: True Aug 31 01:29:07.820360 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Id: default Aug 31 01:29:07.820360 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Name: Default Aug 31 01:29:07.820360 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Id: ed11221969d14b2bb6ba403dd9c412a1 Aug 31 01:29:07.820360 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Name: tempest-VolumesNegativeTest-793796632 Aug 31 01:29:07.820360 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Role: member,reader Aug 31 01:29:07.820360 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Roles: member,reader Aug 31 01:29:07.822102 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ed11221969d14b2bb6ba403dd9c412a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ed11221969d14b2bb6ba403dd9c412a1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ed11221969d14b2bb6ba403dd9c412a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ed11221969d14b2bb6ba403dd9c412a1"}]}] Aug 31 01:29:07.822102 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant: tempest-VolumesNegativeTest-793796632 Aug 31 01:29:07.822102 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Id: ed11221969d14b2bb6ba403dd9c412a1 Aug 31 01:29:07.822102 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Name: tempest-VolumesNegativeTest-793796632 Aug 31 01:29:07.822102 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User: tempest-VolumesNegativeTest-793796632-project Aug 31 01:29:07.822102 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Id: default Aug 31 01:29:07.822102 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Name: Default Aug 31 01:29:07.822102 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Id: 66b52863c45b42dda4dad08e3b809ad0 Aug 31 01:29:07.822102 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Name: tempest-VolumesNegativeTest-793796632-project Aug 31 01:29:07.822102 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: method: Aug 31 01:29:07.822102 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: exception: Volume 09eaef61-f755-4e06-9a79-30907b6a074a could not be found. Aug 31 01:29:07.822102 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: action_args: {'id': '09eaef61-f755-4e06-9a79-30907b6a074a'} Aug 31 01:29:07.822102 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:29:07.823095 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:07.823095 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 01:29:07.823095 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 01:29:07.823095 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 01:29:07.823095 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 01:29:07.823095 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 01:29:07.823095 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 01:29:07.823095 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 01:29:07.823095 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 01:29:07.823095 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 01:29:07.823095 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 01:29:07.823095 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 01:29:07.823095 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 01:29:07.823095 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 01:29:07.823095 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 01:29:07.823095 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 09eaef61-f755-4e06-9a79-30907b6a074a could not be found. (HTTP 404) (Request-ID: req-7b9a0fc2-72d4-4aae-96a7-4fd2a7c00b0f) Aug 31 01:29:07.823095 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:07.823095 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:07.823095 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:07.824448 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:07.824448 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 01:29:07.824448 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 01:29:07.824448 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 01:29:07.824448 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 01:29:07.824448 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 01:29:07.824448 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 01:29:07.824448 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 01:29:07.824448 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 01:29:07.824448 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 01:29:07.824448 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 01:29:07.824448 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 01:29:07.824448 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 01:29:07.824448 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 01:29:07.824448 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 01:29:07.824448 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 01:29:07.824448 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 01:29:07.824448 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 01:29:07.824448 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 01:29:07.829986 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 01:29:07.829986 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 01:29:07.829986 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 01:29:07.829986 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 01:29:07.829986 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 09eaef61-f755-4e06-9a79-30907b6a074a could not be found. Aug 31 01:29:07.829986 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:07.829986 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:07.829986 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:07.829986 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:07.829986 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:07.829986 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:07.829986 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:29:07.829986 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:29:07.829986 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 01:29:07.829986 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 01:29:07.829986 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:29:07.829986 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:29:07.829986 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 01:29:07.829986 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:29:07.831357 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 09eaef61-f755-4e06-9a79-30907b6a074a could not be found. Aug 31 01:29:07.831357 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:07.831357 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:07.831357 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:07.831357 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:07.831357 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:07.831357 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:07.831357 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:29:07.831357 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:29:07.831357 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 09eaef61-f755-4e06-9a79-30907b6a074a could not be found. Aug 31 01:29:07.831357 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:07.831357 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-fecc57ff-3328-473e-97e7-2c1e7cd834bd tempest-VolumesNegativeTest-793796632 tempest-VolumesNegativeTest-793796632-project] Returning 404 to user: Volume 09eaef61-f755-4e06-9a79-30907b6a074a could not be found. {{(pid=121025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:29:07.831357 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-fecc57ff-3328-473e-97e7-2c1e7cd834bd tempest-VolumesNegativeTest-793796632 tempest-VolumesNegativeTest-793796632-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/09eaef61-f755-4e06-9a79-30907b6a074a" status: 404 len: 109 microversion: 2.1 time: 0.035682 Aug 31 01:29:07.831357 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 392/775] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 31 01:29:07 2022] GET /compute/v2.1/os-volumes/09eaef61-f755-4e06-9a79-30907b6a074a => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:29:08.558316 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-6f4376bf-9a59-47a3-9247-7ec951983577 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:08.558934 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-6f4376bf-9a59-47a3-9247-7ec951983577 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:08.565037 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6f4376bf-9a59-47a3-9247-7ec951983577 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:08.565522 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6f4376bf-9a59-47a3-9247-7ec951983577 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:08.566150 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6f4376bf-9a59-47a3-9247-7ec951983577 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:08.566841 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6f4376bf-9a59-47a3-9247-7ec951983577 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:08.567295 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6f4376bf-9a59-47a3-9247-7ec951983577 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:08.567715 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6f4376bf-9a59-47a3-9247-7ec951983577 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:08.701962 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-6f4376bf-9a59-47a3-9247-7ec951983577 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:29:08.704291 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:29:08.712446 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-6f4376bf-9a59-47a3-9247-7ec951983577 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1596 microversion: 2.1 time: 0.159401 Aug 31 01:29:08.713047 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 384/776] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:29:08 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1596 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:29:09.208526 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-246ca91d-bf86-45dc-8a8f-85825ef5749a tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:09.209772 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-246ca91d-bf86-45dc-8a8f-85825ef5749a tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: f29a15ea-aad6-4491-a2e4-602f9ee66899] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:09.221701 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-246ca91d-bf86-45dc-8a8f-85825ef5749a tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:09.221701 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-246ca91d-bf86-45dc-8a8f-85825ef5749a tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:09.221701 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-246ca91d-bf86-45dc-8a8f-85825ef5749a tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:09.221701 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-246ca91d-bf86-45dc-8a8f-85825ef5749a tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:09.222108 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-246ca91d-bf86-45dc-8a8f-85825ef5749a tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:09.222108 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-246ca91d-bf86-45dc-8a8f-85825ef5749a tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:09.227145 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:29:09.256040 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-246ca91d-bf86-45dc-8a8f-85825ef5749a tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899/os-volume_attachments/e6a1ed2b-107d-4130-a90f-d3b7d0725ea9" status: 200 len: 194 microversion: 2.1 time: 0.065501 Aug 31 01:29:09.257179 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 393/777] 10.222.0.20 () {58 vars in 1413 bytes} [Wed Aug 31 01:29:09 2022] GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899/os-volume_attachments/e6a1ed2b-107d-4130-a90f-d3b7d0725ea9 => generated 194 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:29:09.269037 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-841f2263-4afd-48b0-9a54-87f6fdebce2d tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:09.269713 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-841f2263-4afd-48b0-9a54-87f6fdebce2d tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: f29a15ea-aad6-4491-a2e4-602f9ee66899] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:09.277799 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-841f2263-4afd-48b0-9a54-87f6fdebce2d tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:09.278955 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-841f2263-4afd-48b0-9a54-87f6fdebce2d tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:09.279609 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-841f2263-4afd-48b0-9a54-87f6fdebce2d tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:09.280877 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-841f2263-4afd-48b0-9a54-87f6fdebce2d tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:09.281554 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-841f2263-4afd-48b0-9a54-87f6fdebce2d tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:09.282404 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-841f2263-4afd-48b0-9a54-87f6fdebce2d tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:09.364427 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.objects.instance [None req-841f2263-4afd-48b0-9a54-87f6fdebce2d tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lazy-loading 'services' on Instance uuid f29a15ea-aad6-4491-a2e4-602f9ee66899 {{(pid=121026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:29:09.664275 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-841f2263-4afd-48b0-9a54-87f6fdebce2d tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899/os-volume_attachments/e6a1ed2b-107d-4130-a90f-d3b7d0725ea9" status: 202 len: 0 microversion: 2.1 time: 0.400124 Aug 31 01:29:09.664856 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 385/778] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 31 01:29:09 2022] DELETE /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899/os-volume_attachments/e6a1ed2b-107d-4130-a90f-d3b7d0725ea9 => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 01:29:10.856827 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-2ca7e883-9fed-43b5-ab89-869ed011804b tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:10.858972 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-2ca7e883-9fed-43b5-ab89-869ed011804b tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: f29a15ea-aad6-4491-a2e4-602f9ee66899] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:10.867191 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2ca7e883-9fed-43b5-ab89-869ed011804b tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:10.872043 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2ca7e883-9fed-43b5-ab89-869ed011804b tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:10.872043 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2ca7e883-9fed-43b5-ab89-869ed011804b tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:10.872043 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2ca7e883-9fed-43b5-ab89-869ed011804b tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:10.872043 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2ca7e883-9fed-43b5-ab89-869ed011804b tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:10.872534 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2ca7e883-9fed-43b5-ab89-869ed011804b tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:10.903710 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-2ca7e883-9fed-43b5-ab89-869ed011804b tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051259 Aug 31 01:29:10.904479 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 394/779] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 01:29:10 2022] GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 01:29:11.039907 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-1d7f3fc8-0506-428f-a2c2-7c03fd0bc6db tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:11.043896 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-1d7f3fc8-0506-428f-a2c2-7c03fd0bc6db tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: f29a15ea-aad6-4491-a2e4-602f9ee66899] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:11.050371 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1d7f3fc8-0506-428f-a2c2-7c03fd0bc6db tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:11.051301 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1d7f3fc8-0506-428f-a2c2-7c03fd0bc6db tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:11.052001 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1d7f3fc8-0506-428f-a2c2-7c03fd0bc6db tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:11.052891 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1d7f3fc8-0506-428f-a2c2-7c03fd0bc6db tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:11.053453 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1d7f3fc8-0506-428f-a2c2-7c03fd0bc6db tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:11.054065 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1d7f3fc8-0506-428f-a2c2-7c03fd0bc6db tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:11.060997 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-f06a27b8-6384-462b-8907-630f2b226fa1 req-4fce4a9e-0c9f-4340-84ee-b8614c8c62e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa12f850-924b-4bc9-8f32-c3f25e4a4d7d", "tag": "9a52ea97-a4a8-4c98-835c-b0b492daa956"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:29:11.074925 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-f06a27b8-6384-462b-8907-630f2b226fa1 req-4fce4a9e-0c9f-4340-84ee-b8614c8c62e3 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:11.076425 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-f06a27b8-6384-462b-8907-630f2b226fa1 req-4fce4a9e-0c9f-4340-84ee-b8614c8c62e3 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:11.076425 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-f06a27b8-6384-462b-8907-630f2b226fa1 req-4fce4a9e-0c9f-4340-84ee-b8614c8c62e3 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:11.088887 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-f06a27b8-6384-462b-8907-630f2b226fa1 req-4fce4a9e-0c9f-4340-84ee-b8614c8c62e3 service nova] Creating event network-changed:9a52ea97-a4a8-4c98-835c-b0b492daa956 for instance aa12f850-924b-4bc9-8f32-c3f25e4a4d7d on hv-cinder-85528 Aug 31 01:29:11.094028 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-f06a27b8-6384-462b-8907-630f2b226fa1 req-4fce4a9e-0c9f-4340-84ee-b8614c8c62e3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036978 Aug 31 01:29:11.097712 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 395/780] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:29:11.106660 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-1d7f3fc8-0506-428f-a2c2-7c03fd0bc6db tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.075085 Aug 31 01:29:11.112967 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 386/781] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 01:29:11 2022] GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 01:29:11.175586 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-4534adf0-42d2-460b-9bd5-d18ff84e7233 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:11.178759 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-4534adf0-42d2-460b-9bd5-d18ff84e7233 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: f29a15ea-aad6-4491-a2e4-602f9ee66899] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:11.185009 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4534adf0-42d2-460b-9bd5-d18ff84e7233 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:11.185705 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4534adf0-42d2-460b-9bd5-d18ff84e7233 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:11.186522 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4534adf0-42d2-460b-9bd5-d18ff84e7233 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:11.187592 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4534adf0-42d2-460b-9bd5-d18ff84e7233 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:11.188297 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4534adf0-42d2-460b-9bd5-d18ff84e7233 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:11.188999 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4534adf0-42d2-460b-9bd5-d18ff84e7233 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:11.221606 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-4534adf0-42d2-460b-9bd5-d18ff84e7233 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: f29a15ea-aad6-4491-a2e4-602f9ee66899] Going to try to terminate instance {{(pid=121025) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 01:29:11.534927 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-4534adf0-42d2-460b-9bd5-d18ff84e7233 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899" status: 204 len: 0 microversion: 2.1 time: 0.361523 Aug 31 01:29:11.536646 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 396/782] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 01:29:11 2022] DELETE /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 01:29:11.545167 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-74f686df-5a50-41fe-bd02-dec84d5232d6 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:11.545843 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-74f686df-5a50-41fe-bd02-dec84d5232d6 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: f29a15ea-aad6-4491-a2e4-602f9ee66899] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:11.551786 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-74f686df-5a50-41fe-bd02-dec84d5232d6 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:11.552344 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-74f686df-5a50-41fe-bd02-dec84d5232d6 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:11.552939 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-74f686df-5a50-41fe-bd02-dec84d5232d6 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:11.553805 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-74f686df-5a50-41fe-bd02-dec84d5232d6 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:11.554261 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-74f686df-5a50-41fe-bd02-dec84d5232d6 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:11.554685 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-74f686df-5a50-41fe-bd02-dec84d5232d6 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:11.698923 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-74f686df-5a50-41fe-bd02-dec84d5232d6 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:29:11.712260 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-74f686df-5a50-41fe-bd02-dec84d5232d6 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899" status: 200 len: 1674 microversion: 2.1 time: 0.171085 Aug 31 01:29:11.714611 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 387/783] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:29:11 2022] GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899 => generated 1674 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:29:12.736574 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-1f2435a8-7bc2-4801-80ff-759100af4b7e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:12.737548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-1f2435a8-7bc2-4801-80ff-759100af4b7e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: f29a15ea-aad6-4491-a2e4-602f9ee66899] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:12.745540 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1f2435a8-7bc2-4801-80ff-759100af4b7e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:12.752460 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1f2435a8-7bc2-4801-80ff-759100af4b7e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:12.753359 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1f2435a8-7bc2-4801-80ff-759100af4b7e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:12.754339 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1f2435a8-7bc2-4801-80ff-759100af4b7e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:12.755012 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1f2435a8-7bc2-4801-80ff-759100af4b7e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:12.755644 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1f2435a8-7bc2-4801-80ff-759100af4b7e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:12.913840 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-1f2435a8-7bc2-4801-80ff-759100af4b7e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:29:12.923224 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-1f2435a8-7bc2-4801-80ff-759100af4b7e tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899" status: 200 len: 1674 microversion: 2.1 time: 0.191306 Aug 31 01:29:12.923824 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 397/784] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:29:12 2022] GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899 => generated 1674 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:29:13.648708 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-877ee657-095d-4d02-ad1a-bad28f602014 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2009313173"}} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:29:13.649287 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-877ee657-095d-4d02-ad1a-bad28f602014 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:13.655983 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-877ee657-095d-4d02-ad1a-bad28f602014 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:13.657779 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-877ee657-095d-4d02-ad1a-bad28f602014 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:13.657779 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-877ee657-095d-4d02-ad1a-bad28f602014 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:13.657779 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-877ee657-095d-4d02-ad1a-bad28f602014 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:13.658239 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-877ee657-095d-4d02-ad1a-bad28f602014 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:13.658666 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-877ee657-095d-4d02-ad1a-bad28f602014 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:13.946042 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-45cded09-f9b6-4ecc-a6c9-6a9f81dd14e4 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:13.946666 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-45cded09-f9b6-4ecc-a6c9-6a9f81dd14e4 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: f29a15ea-aad6-4491-a2e4-602f9ee66899] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:13.953550 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-45cded09-f9b6-4ecc-a6c9-6a9f81dd14e4 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:13.954041 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-45cded09-f9b6-4ecc-a6c9-6a9f81dd14e4 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:13.954466 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-45cded09-f9b6-4ecc-a6c9-6a9f81dd14e4 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:13.955416 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-45cded09-f9b6-4ecc-a6c9-6a9f81dd14e4 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:13.955859 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-45cded09-f9b6-4ecc-a6c9-6a9f81dd14e4 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:13.956270 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-45cded09-f9b6-4ecc-a6c9-6a9f81dd14e4 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:14.186576 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.network.security_group_api [None req-877ee657-095d-4d02-ad1a-bad28f602014 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Adding security group 330e6ac8-6ca1-473d-bc66-9bf1ae91d293 to port 9a52ea97-a4a8-4c98-835c-b0b492daa956 Aug 31 01:29:14.363045 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-45cded09-f9b6-4ecc-a6c9-6a9f81dd14e4 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:29:14.371562 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-45cded09-f9b6-4ecc-a6c9-6a9f81dd14e4 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899" status: 200 len: 1674 microversion: 2.1 time: 0.429993 Aug 31 01:29:14.372137 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 398/785] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:29:13 2022] GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899 => generated 1674 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:29:14.757637 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-877ee657-095d-4d02-ad1a-bad28f602014 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "POST /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d/action" status: 202 len: 0 microversion: 2.1 time: 1.113435 Aug 31 01:29:14.761734 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 388/786] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 31 01:29:13 2022] POST /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d/action => generated 0 bytes in 1118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 01:29:14.767174 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-19349fb1-025d-449d-bcec-e0a5f9b84d99 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:14.767781 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-19349fb1-025d-449d-bcec-e0a5f9b84d99 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:14.773841 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:29:14.781382 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [req-11256dc9-f634-4ffc-ac94-6753c0ead4e7 req-e0583ad8-8896-4ab8-9952-53b9b913ec22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa12f850-924b-4bc9-8f32-c3f25e4a4d7d", "tag": "9a52ea97-a4a8-4c98-835c-b0b492daa956"}]} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:29:14.788387 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-19349fb1-025d-449d-bcec-e0a5f9b84d99 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:14.788612 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-19349fb1-025d-449d-bcec-e0a5f9b84d99 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:14.789078 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-19349fb1-025d-449d-bcec-e0a5f9b84d99 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:14.789784 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-19349fb1-025d-449d-bcec-e0a5f9b84d99 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:14.790232 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-19349fb1-025d-449d-bcec-e0a5f9b84d99 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:14.790648 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-19349fb1-025d-449d-bcec-e0a5f9b84d99 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:14.800894 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-11256dc9-f634-4ffc-ac94-6753c0ead4e7 req-e0583ad8-8896-4ab8-9952-53b9b913ec22 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:14.801628 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-11256dc9-f634-4ffc-ac94-6753c0ead4e7 req-e0583ad8-8896-4ab8-9952-53b9b913ec22 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:14.802246 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-11256dc9-f634-4ffc-ac94-6753c0ead4e7 req-e0583ad8-8896-4ab8-9952-53b9b913ec22 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:14.821938 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.compute.server_external_events [req-11256dc9-f634-4ffc-ac94-6753c0ead4e7 req-e0583ad8-8896-4ab8-9952-53b9b913ec22 service nova] Creating event network-changed:9a52ea97-a4a8-4c98-835c-b0b492daa956 for instance aa12f850-924b-4bc9-8f32-c3f25e4a4d7d on hv-cinder-85528 Aug 31 01:29:14.833724 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [req-11256dc9-f634-4ffc-ac94-6753c0ead4e7 req-e0583ad8-8896-4ab8-9952-53b9b913ec22 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055696 Aug 31 01:29:14.835473 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 389/787] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:29:14.980247 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-19349fb1-025d-449d-bcec-e0a5f9b84d99 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:29:14.988785 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-19349fb1-025d-449d-bcec-e0a5f9b84d99 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1762 microversion: 2.1 time: 0.225632 Aug 31 01:29:14.989364 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 399/788] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:29:14 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1762 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:29:15.394204 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-7145bd7e-e862-4bc9-ad34-884f6f25d83d tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:15.394899 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-7145bd7e-e862-4bc9-ad34-884f6f25d83d tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: f29a15ea-aad6-4491-a2e4-602f9ee66899] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:15.406356 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7145bd7e-e862-4bc9-ad34-884f6f25d83d tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:15.406844 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7145bd7e-e862-4bc9-ad34-884f6f25d83d tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:15.407489 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7145bd7e-e862-4bc9-ad34-884f6f25d83d tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:15.408365 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7145bd7e-e862-4bc9-ad34-884f6f25d83d tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:15.412445 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7145bd7e-e862-4bc9-ad34-884f6f25d83d tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:15.413115 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7145bd7e-e862-4bc9-ad34-884f6f25d83d tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:15.549237 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-7145bd7e-e862-4bc9-ad34-884f6f25d83d tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3db55df284cd39f28fcfefc619fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb863f706c3846db958c9b7fe367c3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:29:15.557718 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-7145bd7e-e862-4bc9-ad34-884f6f25d83d tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899" status: 200 len: 1323 microversion: 2.1 time: 0.167629 Aug 31 01:29:15.558320 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 390/789] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:29:15 2022] GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899 => generated 1323 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:29:16.578810 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-35967506-cc05-4716-a0d5-c5f50480df06 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:16.579431 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-35967506-cc05-4716-a0d5-c5f50480df06 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: f29a15ea-aad6-4491-a2e4-602f9ee66899] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:16.586253 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-35967506-cc05-4716-a0d5-c5f50480df06 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:16.586683 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-35967506-cc05-4716-a0d5-c5f50480df06 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:16.587180 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-35967506-cc05-4716-a0d5-c5f50480df06 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:16.587878 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-35967506-cc05-4716-a0d5-c5f50480df06 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:16.588334 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-35967506-cc05-4716-a0d5-c5f50480df06 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:16.588777 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-35967506-cc05-4716-a0d5-c5f50480df06 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:16.602168 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.wsgi [None req-35967506-cc05-4716-a0d5-c5f50480df06 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] HTTP exception thrown: Instance f29a15ea-aad6-4491-a2e4-602f9ee66899 could not be found. Aug 31 01:29:16.603793 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-35967506-cc05-4716-a0d5-c5f50480df06 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Request method failure captured: Aug 31 01:29:16.603793 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: request: GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899 HTTP/1.1 Aug 31 01:29:16.603793 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept: application/json Aug 31 01:29:16.603793 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept-Encoding: identity Aug 31 01:29:16.603793 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Connection: close Aug 31 01:29:16.603793 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Length: 0 Aug 31 01:29:16.603793 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Type: application/json Aug 31 01:29:16.603793 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Host: 10.222.0.20 Aug 31 01:29:16.603793 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Openstack-System-Scope: None Aug 31 01:29:16.603793 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: User-Agent: python-urllib3/1.26.12 Aug 31 01:29:16.603793 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Auth-Token: gAAAAABjDrgiFX4hHT0f6yuur92UlJsOMqhv6TNqjWHj9hPIbbaojfmVhHBbslHgSlKYO1wW11SLzR79NCVD5awXtoB9TMVCM_YcM7Jz_GEMFPhHmoW_8vlLFpqIyulHHwjhgM0jsADuUZIAE7_N8U1KHD9TlRVR4EyuRKYDUFSC7891geHlU6g Aug 31 01:29:16.603793 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Id: None Aug 31 01:29:16.603793 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Name: None Aug 31 01:29:16.603793 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Identity-Status: Confirmed Aug 31 01:29:16.603793 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Is-Admin-Project: True Aug 31 01:29:16.603793 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Id: default Aug 31 01:29:16.603793 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Name: Default Aug 31 01:29:16.603793 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Id: fb863f706c3846db958c9b7fe367c3f5 Aug 31 01:29:16.603793 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Name: tempest-AttachVolumeTestJSON-1893250502 Aug 31 01:29:16.603793 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Role: member,reader Aug 31 01:29:16.603793 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Roles: member,reader Aug 31 01:29:16.605422 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fb863f706c3846db958c9b7fe367c3f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fb863f706c3846db958c9b7fe367c3f5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb863f706c3846db958c9b7fe367c3f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb863f706c3846db958c9b7fe367c3f5"}]}] Aug 31 01:29:16.605422 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant: tempest-AttachVolumeTestJSON-1893250502 Aug 31 01:29:16.605422 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Id: fb863f706c3846db958c9b7fe367c3f5 Aug 31 01:29:16.605422 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1893250502 Aug 31 01:29:16.605422 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User: tempest-AttachVolumeTestJSON-1893250502-project Aug 31 01:29:16.605422 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Id: default Aug 31 01:29:16.605422 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Name: Default Aug 31 01:29:16.605422 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Id: 1cc3db55df284cd39f28fcfefc619fda Aug 31 01:29:16.605422 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Name: tempest-AttachVolumeTestJSON-1893250502-project Aug 31 01:29:16.605422 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: method: > Aug 31 01:29:16.605422 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: exception: Instance f29a15ea-aad6-4491-a2e4-602f9ee66899 could not be found. Aug 31 01:29:16.605422 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: action_args: {'id': 'f29a15ea-aad6-4491-a2e4-602f9ee66899'} Aug 31 01:29:16.606578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:29:16.606578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:16.606578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:29:16.606578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:29:16.606578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:29:16.606578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:29:16.606578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:29:16.606578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:29:16.606578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:29:16.606578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:29:16.606578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f29a15ea-aad6-4491-a2e4-602f9ee66899 could not be found. Aug 31 01:29:16.606578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:16.606578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:16.606578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:16.606578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:16.606578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:16.606578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:16.606578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:29:16.606578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:29:16.606578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:29:16.608170 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:29:16.608170 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:29:16.608170 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:29:16.608170 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:29:16.608170 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:29:16.608170 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:29:16.608170 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:29:16.608170 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f29a15ea-aad6-4491-a2e4-602f9ee66899 could not be found. Aug 31 01:29:16.608170 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:16.608170 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:16.608170 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:16.608170 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:16.608170 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:16.608170 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:16.608170 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:29:16.608170 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:29:16.608170 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f29a15ea-aad6-4491-a2e4-602f9ee66899 could not be found. Aug 31 01:29:16.608170 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:16.609706 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-35967506-cc05-4716-a0d5-c5f50480df06 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Returning 404 to user: Instance f29a15ea-aad6-4491-a2e4-602f9ee66899 could not be found. {{(pid=121025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:29:16.609706 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-35967506-cc05-4716-a0d5-c5f50480df06 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899" status: 404 len: 111 microversion: 2.1 time: 0.030433 Aug 31 01:29:16.609706 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 400/790] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:29:16 2022] GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:29:16.614086 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-e5962d7c-c21a-4b0c-b000-61b1b2ae001c tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '.version_select at 0x7f1fe15ae0d0>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:16.675884 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-e5962d7c-c21a-4b0c-b000-61b1b2ae001c tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1556386132" status: 202 len: 0 microversion: 2.1 time: 0.065575 Aug 31 01:29:16.676476 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 391/791] 10.222.0.20 () {58 vars in 1221 bytes} [Wed Aug 31 01:29:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1556386132 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 01:29:16.856829 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-9bd52f49-d7b4-4eaa-b1f9-3164082f374a req-f35e9172-e0c3-4471-ae09-ee8130912411 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f29a15ea-aad6-4491-a2e4-602f9ee66899", "name": "network-vif-deleted", "tag": "cdfb0f64-8b81-4f78-aca5-823b4f781b7b"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:29:16.867965 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-9bd52f49-d7b4-4eaa-b1f9-3164082f374a req-f35e9172-e0c3-4471-ae09-ee8130912411 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:16.868459 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-9bd52f49-d7b4-4eaa-b1f9-3164082f374a req-f35e9172-e0c3-4471-ae09-ee8130912411 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:16.868932 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-9bd52f49-d7b4-4eaa-b1f9-3164082f374a req-f35e9172-e0c3-4471-ae09-ee8130912411 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:16.880507 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-9bd52f49-d7b4-4eaa-b1f9-3164082f374a req-f35e9172-e0c3-4471-ae09-ee8130912411 service nova] Creating event network-vif-deleted:cdfb0f64-8b81-4f78-aca5-823b4f781b7b for instance f29a15ea-aad6-4491-a2e4-602f9ee66899 on hv-cinder-85528 Aug 31 01:29:16.885575 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-9bd52f49-d7b4-4eaa-b1f9-3164082f374a req-f35e9172-e0c3-4471-ae09-ee8130912411 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032289 Aug 31 01:29:16.886048 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 401/792] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:29:19.957950 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-db0e2b30-9922-4b59-858e-8e431571d1b0 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:19.958577 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-db0e2b30-9922-4b59-858e-8e431571d1b0 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: f29a15ea-aad6-4491-a2e4-602f9ee66899] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:19.960985 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:29:19.966235 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-db0e2b30-9922-4b59-858e-8e431571d1b0 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:19.966660 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-db0e2b30-9922-4b59-858e-8e431571d1b0 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:19.967085 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-db0e2b30-9922-4b59-858e-8e431571d1b0 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:19.967766 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-db0e2b30-9922-4b59-858e-8e431571d1b0 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:19.968213 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-db0e2b30-9922-4b59-858e-8e431571d1b0 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:19.968629 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-db0e2b30-9922-4b59-858e-8e431571d1b0 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:19.982106 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.wsgi [None req-db0e2b30-9922-4b59-858e-8e431571d1b0 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] HTTP exception thrown: Instance f29a15ea-aad6-4491-a2e4-602f9ee66899 could not be found. Aug 31 01:29:19.983741 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-db0e2b30-9922-4b59-858e-8e431571d1b0 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Request method failure captured: Aug 31 01:29:19.983741 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: request: DELETE /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899 HTTP/1.1 Aug 31 01:29:19.983741 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept: application/json Aug 31 01:29:19.983741 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept-Encoding: identity Aug 31 01:29:19.983741 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Connection: close Aug 31 01:29:19.983741 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Length: 0 Aug 31 01:29:19.983741 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Type: application/json Aug 31 01:29:19.983741 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Host: 10.222.0.20 Aug 31 01:29:19.983741 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Openstack-System-Scope: None Aug 31 01:29:19.983741 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: User-Agent: python-urllib3/1.26.12 Aug 31 01:29:19.983741 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Auth-Token: gAAAAABjDrgiFX4hHT0f6yuur92UlJsOMqhv6TNqjWHj9hPIbbaojfmVhHBbslHgSlKYO1wW11SLzR79NCVD5awXtoB9TMVCM_YcM7Jz_GEMFPhHmoW_8vlLFpqIyulHHwjhgM0jsADuUZIAE7_N8U1KHD9TlRVR4EyuRKYDUFSC7891geHlU6g Aug 31 01:29:19.983741 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Id: None Aug 31 01:29:19.983741 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Name: None Aug 31 01:29:19.983741 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Identity-Status: Confirmed Aug 31 01:29:19.983741 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Is-Admin-Project: True Aug 31 01:29:19.983741 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Id: default Aug 31 01:29:19.983741 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Name: Default Aug 31 01:29:19.983741 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Id: fb863f706c3846db958c9b7fe367c3f5 Aug 31 01:29:19.983741 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Name: tempest-AttachVolumeTestJSON-1893250502 Aug 31 01:29:19.983741 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Role: member,reader Aug 31 01:29:19.983741 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Roles: member,reader Aug 31 01:29:19.985332 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fb863f706c3846db958c9b7fe367c3f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fb863f706c3846db958c9b7fe367c3f5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb863f706c3846db958c9b7fe367c3f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb863f706c3846db958c9b7fe367c3f5"}]}] Aug 31 01:29:19.985332 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant: tempest-AttachVolumeTestJSON-1893250502 Aug 31 01:29:19.985332 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Id: fb863f706c3846db958c9b7fe367c3f5 Aug 31 01:29:19.985332 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1893250502 Aug 31 01:29:19.985332 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User: tempest-AttachVolumeTestJSON-1893250502-project Aug 31 01:29:19.985332 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Id: default Aug 31 01:29:19.985332 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Name: Default Aug 31 01:29:19.985332 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Id: 1cc3db55df284cd39f28fcfefc619fda Aug 31 01:29:19.985332 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Name: tempest-AttachVolumeTestJSON-1893250502-project Aug 31 01:29:19.985332 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: method: > Aug 31 01:29:19.985332 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: exception: Instance f29a15ea-aad6-4491-a2e4-602f9ee66899 could not be found. Aug 31 01:29:19.985332 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: action_args: {'id': 'f29a15ea-aad6-4491-a2e4-602f9ee66899'} Aug 31 01:29:19.986637 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:29:19.986637 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:19.986637 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:29:19.986637 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:29:19.986637 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:29:19.986637 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:29:19.986637 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:29:19.986637 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:29:19.986637 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:29:19.986637 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:29:19.986637 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f29a15ea-aad6-4491-a2e4-602f9ee66899 could not be found. Aug 31 01:29:19.986637 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:19.986637 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:19.986637 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:19.986637 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:19.986637 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:19.986637 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:19.986637 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:29:19.986637 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:29:19.986637 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:29:19.988179 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:29:19.988179 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 01:29:19.988179 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 01:29:19.988179 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 01:29:19.988179 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 01:29:19.988179 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:29:19.988179 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:29:19.988179 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:29:19.988179 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:29:19.988179 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f29a15ea-aad6-4491-a2e4-602f9ee66899 could not be found. Aug 31 01:29:19.988179 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:19.988179 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:19.988179 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:19.988179 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:19.988179 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:19.988179 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:19.988179 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:29:19.988179 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:29:19.988179 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f29a15ea-aad6-4491-a2e4-602f9ee66899 could not be found. Aug 31 01:29:19.988179 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:19.989968 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-db0e2b30-9922-4b59-858e-8e431571d1b0 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Returning 404 to user: Instance f29a15ea-aad6-4491-a2e4-602f9ee66899 could not be found. {{(pid=121026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:29:19.989968 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-db0e2b30-9922-4b59-858e-8e431571d1b0 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899" status: 404 len: 111 microversion: 2.1 time: 0.031862 Aug 31 01:29:19.989968 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 392/793] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 01:29:19 2022] DELETE /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:29:19.995812 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-6e0f8c54-e20a-4798-9636-b163243fad85 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:19.996588 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-6e0f8c54-e20a-4798-9636-b163243fad85 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: f29a15ea-aad6-4491-a2e4-602f9ee66899] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:20.003077 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6e0f8c54-e20a-4798-9636-b163243fad85 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:20.003652 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6e0f8c54-e20a-4798-9636-b163243fad85 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:20.004092 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6e0f8c54-e20a-4798-9636-b163243fad85 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:20.004812 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6e0f8c54-e20a-4798-9636-b163243fad85 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:20.005286 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6e0f8c54-e20a-4798-9636-b163243fad85 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:20.005723 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6e0f8c54-e20a-4798-9636-b163243fad85 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:20.019534 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.wsgi [None req-6e0f8c54-e20a-4798-9636-b163243fad85 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] HTTP exception thrown: Instance f29a15ea-aad6-4491-a2e4-602f9ee66899 could not be found. Aug 31 01:29:20.021240 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-6e0f8c54-e20a-4798-9636-b163243fad85 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Request method failure captured: Aug 31 01:29:20.021240 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: request: GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899 HTTP/1.1 Aug 31 01:29:20.021240 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept: application/json Aug 31 01:29:20.021240 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept-Encoding: identity Aug 31 01:29:20.021240 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Connection: close Aug 31 01:29:20.021240 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Length: 0 Aug 31 01:29:20.021240 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Type: application/json Aug 31 01:29:20.021240 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Host: 10.222.0.20 Aug 31 01:29:20.021240 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Openstack-System-Scope: None Aug 31 01:29:20.021240 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: User-Agent: python-urllib3/1.26.12 Aug 31 01:29:20.021240 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Auth-Token: gAAAAABjDrgiFX4hHT0f6yuur92UlJsOMqhv6TNqjWHj9hPIbbaojfmVhHBbslHgSlKYO1wW11SLzR79NCVD5awXtoB9TMVCM_YcM7Jz_GEMFPhHmoW_8vlLFpqIyulHHwjhgM0jsADuUZIAE7_N8U1KHD9TlRVR4EyuRKYDUFSC7891geHlU6g Aug 31 01:29:20.021240 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Id: None Aug 31 01:29:20.021240 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Name: None Aug 31 01:29:20.021240 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Identity-Status: Confirmed Aug 31 01:29:20.021240 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Is-Admin-Project: True Aug 31 01:29:20.021240 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Id: default Aug 31 01:29:20.021240 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Name: Default Aug 31 01:29:20.021240 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Id: fb863f706c3846db958c9b7fe367c3f5 Aug 31 01:29:20.021240 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Name: tempest-AttachVolumeTestJSON-1893250502 Aug 31 01:29:20.021240 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Role: member,reader Aug 31 01:29:20.021240 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Roles: member,reader Aug 31 01:29:20.023456 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fb863f706c3846db958c9b7fe367c3f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fb863f706c3846db958c9b7fe367c3f5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb863f706c3846db958c9b7fe367c3f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb863f706c3846db958c9b7fe367c3f5"}]}] Aug 31 01:29:20.023456 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant: tempest-AttachVolumeTestJSON-1893250502 Aug 31 01:29:20.023456 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Id: fb863f706c3846db958c9b7fe367c3f5 Aug 31 01:29:20.023456 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1893250502 Aug 31 01:29:20.023456 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User: tempest-AttachVolumeTestJSON-1893250502-project Aug 31 01:29:20.023456 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Id: default Aug 31 01:29:20.023456 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Name: Default Aug 31 01:29:20.023456 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Id: 1cc3db55df284cd39f28fcfefc619fda Aug 31 01:29:20.023456 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Name: tempest-AttachVolumeTestJSON-1893250502-project Aug 31 01:29:20.023456 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: method: > Aug 31 01:29:20.023456 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: exception: Instance f29a15ea-aad6-4491-a2e4-602f9ee66899 could not be found. Aug 31 01:29:20.023456 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: action_args: {'id': 'f29a15ea-aad6-4491-a2e4-602f9ee66899'} Aug 31 01:29:20.024320 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:29:20.024320 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:20.024320 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:29:20.024320 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:29:20.024320 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:29:20.024320 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:29:20.024320 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:29:20.024320 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:29:20.024320 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:29:20.024320 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:29:20.024320 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f29a15ea-aad6-4491-a2e4-602f9ee66899 could not be found. Aug 31 01:29:20.024320 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:20.024320 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:20.024320 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:20.024320 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:20.024320 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:20.024320 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:20.024320 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:29:20.024320 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:29:20.024320 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:29:20.025599 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:29:20.025599 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:29:20.025599 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:29:20.025599 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:29:20.025599 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:29:20.025599 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:29:20.025599 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:29:20.025599 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f29a15ea-aad6-4491-a2e4-602f9ee66899 could not be found. Aug 31 01:29:20.025599 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:20.025599 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:20.025599 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:20.025599 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:20.025599 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:20.025599 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:20.025599 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:29:20.025599 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:29:20.025599 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f29a15ea-aad6-4491-a2e4-602f9ee66899 could not be found. Aug 31 01:29:20.025599 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:20.026777 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-6e0f8c54-e20a-4798-9636-b163243fad85 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Returning 404 to user: Instance f29a15ea-aad6-4491-a2e4-602f9ee66899 could not be found. {{(pid=121025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:29:20.026777 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-6e0f8c54-e20a-4798-9636-b163243fad85 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899" status: 404 len: 111 microversion: 2.1 time: 0.032391 Aug 31 01:29:20.026777 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 402/794] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:29:19 2022] GET /compute/v2.1/servers/f29a15ea-aad6-4491-a2e4-602f9ee66899 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:29:21.377698 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-bbe775f3-860a-4cfa-a0ce-8b4d5ac3a059 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:21.378191 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-bbe775f3-860a-4cfa-a0ce-8b4d5ac3a059 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:21.385264 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-bbe775f3-860a-4cfa-a0ce-8b4d5ac3a059 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:21.388288 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-bbe775f3-860a-4cfa-a0ce-8b4d5ac3a059 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:21.388288 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-bbe775f3-860a-4cfa-a0ce-8b4d5ac3a059 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:21.388288 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-bbe775f3-860a-4cfa-a0ce-8b4d5ac3a059 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:21.388288 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-bbe775f3-860a-4cfa-a0ce-8b4d5ac3a059 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:21.388709 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-bbe775f3-860a-4cfa-a0ce-8b4d5ac3a059 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:21.401394 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.wsgi [None req-bbe775f3-860a-4cfa-a0ce-8b4d5ac3a059 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] HTTP exception thrown: Instance 368bac0a-39c9-4f1e-99f9-84223e7de06b could not be found. Aug 31 01:29:21.402935 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-bbe775f3-860a-4cfa-a0ce-8b4d5ac3a059 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Request method failure captured: Aug 31 01:29:21.402935 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: request: DELETE /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b HTTP/1.1 Aug 31 01:29:21.402935 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept: application/json Aug 31 01:29:21.402935 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept-Encoding: identity Aug 31 01:29:21.402935 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Connection: close Aug 31 01:29:21.402935 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Length: 0 Aug 31 01:29:21.402935 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Type: application/json Aug 31 01:29:21.402935 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Host: 10.222.0.20 Aug 31 01:29:21.402935 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Openstack-System-Scope: None Aug 31 01:29:21.402935 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: User-Agent: python-urllib3/1.26.12 Aug 31 01:29:21.402935 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Auth-Token: gAAAAABjDrgiFX4hHT0f6yuur92UlJsOMqhv6TNqjWHj9hPIbbaojfmVhHBbslHgSlKYO1wW11SLzR79NCVD5awXtoB9TMVCM_YcM7Jz_GEMFPhHmoW_8vlLFpqIyulHHwjhgM0jsADuUZIAE7_N8U1KHD9TlRVR4EyuRKYDUFSC7891geHlU6g Aug 31 01:29:21.402935 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Id: None Aug 31 01:29:21.402935 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Name: None Aug 31 01:29:21.402935 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Identity-Status: Confirmed Aug 31 01:29:21.402935 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Is-Admin-Project: True Aug 31 01:29:21.402935 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Id: default Aug 31 01:29:21.402935 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Name: Default Aug 31 01:29:21.402935 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Id: fb863f706c3846db958c9b7fe367c3f5 Aug 31 01:29:21.402935 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Name: tempest-AttachVolumeTestJSON-1893250502 Aug 31 01:29:21.402935 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Role: member,reader Aug 31 01:29:21.402935 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Roles: member,reader Aug 31 01:29:21.404666 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fb863f706c3846db958c9b7fe367c3f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fb863f706c3846db958c9b7fe367c3f5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb863f706c3846db958c9b7fe367c3f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb863f706c3846db958c9b7fe367c3f5"}]}] Aug 31 01:29:21.404666 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant: tempest-AttachVolumeTestJSON-1893250502 Aug 31 01:29:21.404666 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Id: fb863f706c3846db958c9b7fe367c3f5 Aug 31 01:29:21.404666 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1893250502 Aug 31 01:29:21.404666 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User: tempest-AttachVolumeTestJSON-1893250502-project Aug 31 01:29:21.404666 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Id: default Aug 31 01:29:21.404666 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Name: Default Aug 31 01:29:21.404666 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Id: 1cc3db55df284cd39f28fcfefc619fda Aug 31 01:29:21.404666 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Name: tempest-AttachVolumeTestJSON-1893250502-project Aug 31 01:29:21.404666 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: method: > Aug 31 01:29:21.404666 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: exception: Instance 368bac0a-39c9-4f1e-99f9-84223e7de06b could not be found. Aug 31 01:29:21.404666 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: action_args: {'id': '368bac0a-39c9-4f1e-99f9-84223e7de06b'} Aug 31 01:29:21.405521 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:29:21.405521 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:21.405521 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:29:21.405521 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:29:21.405521 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:29:21.405521 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:29:21.405521 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:29:21.405521 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:29:21.405521 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:29:21.405521 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:29:21.405521 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 368bac0a-39c9-4f1e-99f9-84223e7de06b could not be found. Aug 31 01:29:21.405521 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:21.405521 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:21.405521 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:21.405521 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:21.405521 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:21.405521 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:21.405521 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:29:21.405521 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:29:21.405521 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:29:21.406967 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:29:21.406967 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 01:29:21.406967 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 01:29:21.406967 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 01:29:21.406967 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 01:29:21.406967 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:29:21.406967 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:29:21.406967 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:29:21.406967 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:29:21.406967 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 368bac0a-39c9-4f1e-99f9-84223e7de06b could not be found. Aug 31 01:29:21.406967 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:21.406967 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:21.406967 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:21.406967 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:21.406967 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:21.406967 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:21.406967 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:29:21.406967 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:29:21.406967 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 368bac0a-39c9-4f1e-99f9-84223e7de06b could not be found. Aug 31 01:29:21.406967 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:21.408410 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-bbe775f3-860a-4cfa-a0ce-8b4d5ac3a059 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Returning 404 to user: Instance 368bac0a-39c9-4f1e-99f9-84223e7de06b could not be found. {{(pid=121026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:29:21.408410 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-bbe775f3-860a-4cfa-a0ce-8b4d5ac3a059 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "DELETE /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 404 len: 111 microversion: 2.1 time: 0.030811 Aug 31 01:29:21.408410 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 393/795] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 01:29:21 2022] DELETE /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:29:21.412936 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-f2261ed8-3c8b-4b80-bfd5-0b64b2e4fed8 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:21.413539 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-f2261ed8-3c8b-4b80-bfd5-0b64b2e4fed8 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] [instance: 368bac0a-39c9-4f1e-99f9-84223e7de06b] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:21.420063 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f2261ed8-3c8b-4b80-bfd5-0b64b2e4fed8 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:21.420569 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f2261ed8-3c8b-4b80-bfd5-0b64b2e4fed8 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:21.421034 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f2261ed8-3c8b-4b80-bfd5-0b64b2e4fed8 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:21.421711 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f2261ed8-3c8b-4b80-bfd5-0b64b2e4fed8 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:21.422156 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f2261ed8-3c8b-4b80-bfd5-0b64b2e4fed8 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:21.422568 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f2261ed8-3c8b-4b80-bfd5-0b64b2e4fed8 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:21.437567 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.wsgi [None req-f2261ed8-3c8b-4b80-bfd5-0b64b2e4fed8 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] HTTP exception thrown: Instance 368bac0a-39c9-4f1e-99f9-84223e7de06b could not be found. Aug 31 01:29:21.439395 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-f2261ed8-3c8b-4b80-bfd5-0b64b2e4fed8 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Request method failure captured: Aug 31 01:29:21.439395 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: request: GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b HTTP/1.1 Aug 31 01:29:21.439395 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept: application/json Aug 31 01:29:21.439395 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept-Encoding: identity Aug 31 01:29:21.439395 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Connection: close Aug 31 01:29:21.439395 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Length: 0 Aug 31 01:29:21.439395 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Type: application/json Aug 31 01:29:21.439395 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Host: 10.222.0.20 Aug 31 01:29:21.439395 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Openstack-System-Scope: None Aug 31 01:29:21.439395 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: User-Agent: python-urllib3/1.26.12 Aug 31 01:29:21.439395 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Auth-Token: gAAAAABjDrgiFX4hHT0f6yuur92UlJsOMqhv6TNqjWHj9hPIbbaojfmVhHBbslHgSlKYO1wW11SLzR79NCVD5awXtoB9TMVCM_YcM7Jz_GEMFPhHmoW_8vlLFpqIyulHHwjhgM0jsADuUZIAE7_N8U1KHD9TlRVR4EyuRKYDUFSC7891geHlU6g Aug 31 01:29:21.439395 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Id: None Aug 31 01:29:21.439395 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Name: None Aug 31 01:29:21.439395 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Identity-Status: Confirmed Aug 31 01:29:21.439395 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Is-Admin-Project: True Aug 31 01:29:21.439395 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Id: default Aug 31 01:29:21.439395 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Name: Default Aug 31 01:29:21.439395 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Id: fb863f706c3846db958c9b7fe367c3f5 Aug 31 01:29:21.439395 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Name: tempest-AttachVolumeTestJSON-1893250502 Aug 31 01:29:21.439395 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Role: member,reader Aug 31 01:29:21.439395 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Roles: member,reader Aug 31 01:29:21.441051 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fb863f706c3846db958c9b7fe367c3f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fb863f706c3846db958c9b7fe367c3f5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb863f706c3846db958c9b7fe367c3f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb863f706c3846db958c9b7fe367c3f5"}]}] Aug 31 01:29:21.441051 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant: tempest-AttachVolumeTestJSON-1893250502 Aug 31 01:29:21.441051 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Id: fb863f706c3846db958c9b7fe367c3f5 Aug 31 01:29:21.441051 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1893250502 Aug 31 01:29:21.441051 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User: tempest-AttachVolumeTestJSON-1893250502-project Aug 31 01:29:21.441051 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Id: default Aug 31 01:29:21.441051 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Name: Default Aug 31 01:29:21.441051 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Id: 1cc3db55df284cd39f28fcfefc619fda Aug 31 01:29:21.441051 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Name: tempest-AttachVolumeTestJSON-1893250502-project Aug 31 01:29:21.441051 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: method: > Aug 31 01:29:21.441051 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: exception: Instance 368bac0a-39c9-4f1e-99f9-84223e7de06b could not be found. Aug 31 01:29:21.441051 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: action_args: {'id': '368bac0a-39c9-4f1e-99f9-84223e7de06b'} Aug 31 01:29:21.441914 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:29:21.441914 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:21.441914 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:29:21.441914 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:29:21.441914 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:29:21.441914 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:29:21.441914 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:29:21.441914 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:29:21.441914 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:29:21.441914 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:29:21.441914 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 368bac0a-39c9-4f1e-99f9-84223e7de06b could not be found. Aug 31 01:29:21.441914 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:21.441914 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:21.441914 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:21.441914 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:21.441914 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:21.441914 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:21.441914 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:29:21.441914 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:29:21.441914 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:29:21.443638 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:29:21.443638 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:29:21.443638 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:29:21.443638 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:29:21.443638 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:29:21.443638 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:29:21.443638 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:29:21.443638 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 368bac0a-39c9-4f1e-99f9-84223e7de06b could not be found. Aug 31 01:29:21.443638 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:21.443638 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:21.443638 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:21.443638 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:21.443638 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:21.443638 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:21.443638 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:29:21.443638 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:29:21.443638 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 368bac0a-39c9-4f1e-99f9-84223e7de06b could not be found. Aug 31 01:29:21.443638 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:21.445509 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-f2261ed8-3c8b-4b80-bfd5-0b64b2e4fed8 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] Returning 404 to user: Instance 368bac0a-39c9-4f1e-99f9-84223e7de06b could not be found. {{(pid=121025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:29:21.445509 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-f2261ed8-3c8b-4b80-bfd5-0b64b2e4fed8 tempest-AttachVolumeTestJSON-1893250502 tempest-AttachVolumeTestJSON-1893250502-project] 10.222.0.20 "GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b" status: 404 len: 111 microversion: 2.1 time: 0.031971 Aug 31 01:29:21.445509 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 403/796] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:29:21 2022] GET /compute/v2.1/servers/368bac0a-39c9-4f1e-99f9-84223e7de06b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 01:29:27.017468 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-0280a2ca-4fa9-441d-9c02-b617feb96b9d tempest-VolumesGetTestJSON-501242732 tempest-VolumesGetTestJSON-501242732-project] Action: 'create', calling method: .version_select at 0x7f1fe17088b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-143521814", "metadata": {"Type": "work"}}} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:29:27.663236 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-0280a2ca-4fa9-441d-9c02-b617feb96b9d tempest-VolumesGetTestJSON-501242732 tempest-VolumesGetTestJSON-501242732-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.759606 Aug 31 01:29:27.664001 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 394/797] 10.222.0.20 () {60 vars in 1156 bytes} [Wed Aug 31 01:29:26 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 761 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 31 01:29:27.676235 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-17a34c72-5a2c-473f-ad87-54de2de4c05f tempest-VolumesGetTestJSON-501242732 tempest-VolumesGetTestJSON-501242732-project] Calling method '.version_select at 0x7f1fe14e24c0>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:27.724660 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-17a34c72-5a2c-473f-ad87-54de2de4c05f tempest-VolumesGetTestJSON-501242732 tempest-VolumesGetTestJSON-501242732-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/91502d6a-a014-4dfc-b10e-25bf73a157fd" status: 200 len: 352 microversion: 2.1 time: 0.052146 Aug 31 01:29:27.725856 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 404/798] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 31 01:29:27 2022] GET /compute/v2.1/os-volumes/91502d6a-a014-4dfc-b10e-25bf73a157fd => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:29:28.739235 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-d91f2023-30de-48b2-a6bc-b8bf4f75fd22 tempest-VolumesGetTestJSON-501242732 tempest-VolumesGetTestJSON-501242732-project] Calling method '.version_select at 0x7f1fe15f1f70>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:28.785657 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-d91f2023-30de-48b2-a6bc-b8bf4f75fd22 tempest-VolumesGetTestJSON-501242732 tempest-VolumesGetTestJSON-501242732-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/91502d6a-a014-4dfc-b10e-25bf73a157fd" status: 200 len: 352 microversion: 2.1 time: 0.050630 Aug 31 01:29:28.786208 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 395/799] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 31 01:29:28 2022] GET /compute/v2.1/os-volumes/91502d6a-a014-4dfc-b10e-25bf73a157fd => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:29:29.655390 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-903c67c3-c55a-4aad-ba4e-5b9ff1126368 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:29.657635 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-903c67c3-c55a-4aad-ba4e-5b9ff1126368 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:29.664366 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-903c67c3-c55a-4aad-ba4e-5b9ff1126368 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:29.664882 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-903c67c3-c55a-4aad-ba4e-5b9ff1126368 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:29.665314 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-903c67c3-c55a-4aad-ba4e-5b9ff1126368 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:29.672261 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-903c67c3-c55a-4aad-ba4e-5b9ff1126368 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:29.672261 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-903c67c3-c55a-4aad-ba4e-5b9ff1126368 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:29.672261 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-903c67c3-c55a-4aad-ba4e-5b9ff1126368 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:29.695389 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-903c67c3-c55a-4aad-ba4e-5b9ff1126368 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044395 Aug 31 01:29:29.695953 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 405/800] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 31 01:29:29 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:29:29.758944 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-80819090-a950-4999-b8aa-58833840e8ad tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:29.759450 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-80819090-a950-4999-b8aa-58833840e8ad tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:29.765888 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-80819090-a950-4999-b8aa-58833840e8ad tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:29.766361 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-80819090-a950-4999-b8aa-58833840e8ad tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:29.766787 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-80819090-a950-4999-b8aa-58833840e8ad tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:29.767466 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-80819090-a950-4999-b8aa-58833840e8ad tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:29.767911 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-80819090-a950-4999-b8aa-58833840e8ad tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:29.768329 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-80819090-a950-4999-b8aa-58833840e8ad tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:29.793581 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-80819090-a950-4999-b8aa-58833840e8ad tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Going to try to terminate instance {{(pid=121026) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 01:29:29.798592 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-503574b6-c40c-4721-af7d-c29d7bd69db0 tempest-VolumesGetTestJSON-501242732 tempest-VolumesGetTestJSON-501242732-project] Calling method '.version_select at 0x7f1fe155f1f0>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:29.846773 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-503574b6-c40c-4721-af7d-c29d7bd69db0 tempest-VolumesGetTestJSON-501242732 tempest-VolumesGetTestJSON-501242732-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/91502d6a-a014-4dfc-b10e-25bf73a157fd" status: 200 len: 353 microversion: 2.1 time: 0.051971 Aug 31 01:29:29.847373 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 406/801] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 31 01:29:29 2022] GET /compute/v2.1/os-volumes/91502d6a-a014-4dfc-b10e-25bf73a157fd => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:29:29.859511 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-48212d6a-7875-462c-aeaa-84d8ba8cd62b tempest-VolumesGetTestJSON-501242732 tempest-VolumesGetTestJSON-501242732-project] Calling method '.version_select at 0x7f1fe14e20d0>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:29.907853 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-48212d6a-7875-462c-aeaa-84d8ba8cd62b tempest-VolumesGetTestJSON-501242732 tempest-VolumesGetTestJSON-501242732-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/91502d6a-a014-4dfc-b10e-25bf73a157fd" status: 200 len: 353 microversion: 2.1 time: 0.051903 Aug 31 01:29:29.908488 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 407/802] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 31 01:29:29 2022] GET /compute/v2.1/os-volumes/91502d6a-a014-4dfc-b10e-25bf73a157fd => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:29:29.925531 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-481abff2-efa7-4818-a560-b433b524c72d tempest-VolumesGetTestJSON-501242732 tempest-VolumesGetTestJSON-501242732-project] Calling method '.version_select at 0x7f1fe14e2430>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:30.102983 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-80819090-a950-4999-b8aa-58833840e8ad tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 204 len: 0 microversion: 2.20 time: 0.348658 Aug 31 01:29:30.103574 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 396/803] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Aug 31 01:29:29 2022] DELETE /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 01:29:30.118861 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-f2f97fa6-ecc7-45cc-ad5a-388b3fc938d0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:30.119495 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-f2f97fa6-ecc7-45cc-ad5a-388b3fc938d0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:30.125640 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f2f97fa6-ecc7-45cc-ad5a-388b3fc938d0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:30.126115 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f2f97fa6-ecc7-45cc-ad5a-388b3fc938d0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:30.126563 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f2f97fa6-ecc7-45cc-ad5a-388b3fc938d0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:30.127228 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f2f97fa6-ecc7-45cc-ad5a-388b3fc938d0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:30.127675 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f2f97fa6-ecc7-45cc-ad5a-388b3fc938d0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:30.128094 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f2f97fa6-ecc7-45cc-ad5a-388b3fc938d0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:30.189283 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-481abff2-efa7-4818-a560-b433b524c72d tempest-VolumesGetTestJSON-501242732 tempest-VolumesGetTestJSON-501242732-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/91502d6a-a014-4dfc-b10e-25bf73a157fd" status: 202 len: 0 microversion: 2.1 time: 0.267412 Aug 31 01:29:30.189864 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 408/804] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Aug 31 01:29:29 2022] DELETE /compute/v2.1/os-volumes/91502d6a-a014-4dfc-b10e-25bf73a157fd => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 01:29:30.198531 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-02210254-ec13-40a3-8ea4-cb64c3e982de tempest-VolumesGetTestJSON-501242732 tempest-VolumesGetTestJSON-501242732-project] Calling method '.version_select at 0x7f1fe14e2280>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:30.246945 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-02210254-ec13-40a3-8ea4-cb64c3e982de tempest-VolumesGetTestJSON-501242732 tempest-VolumesGetTestJSON-501242732-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/91502d6a-a014-4dfc-b10e-25bf73a157fd" status: 200 len: 352 microversion: 2.1 time: 0.052216 Aug 31 01:29:30.247578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 409/805] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 31 01:29:30 2022] GET /compute/v2.1/os-volumes/91502d6a-a014-4dfc-b10e-25bf73a157fd => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:29:30.268793 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-f2f97fa6-ecc7-45cc-ad5a-388b3fc938d0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:29:30.277731 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-f2f97fa6-ecc7-45cc-ad5a-388b3fc938d0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:29:30.279219 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-f2f97fa6-ecc7-45cc-ad5a-388b3fc938d0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:29:30.280374 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-f2f97fa6-ecc7-45cc-ad5a-388b3fc938d0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1722 microversion: 2.20 time: 0.166169 Aug 31 01:29:30.281039 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 397/806] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:29:30 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 01:29:31.261758 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-7b5a16fe-ac59-4da6-b8d3-e4e918732e74 tempest-VolumesGetTestJSON-501242732 tempest-VolumesGetTestJSON-501242732-project] Calling method '.version_select at 0x7f1fe155f310>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:31.291547 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.wsgi [None req-7b5a16fe-ac59-4da6-b8d3-e4e918732e74 tempest-VolumesGetTestJSON-501242732 tempest-VolumesGetTestJSON-501242732-project] HTTP exception thrown: Volume 91502d6a-a014-4dfc-b10e-25bf73a157fd could not be found. Aug 31 01:29:31.293533 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-7b5a16fe-ac59-4da6-b8d3-e4e918732e74 tempest-VolumesGetTestJSON-501242732 tempest-VolumesGetTestJSON-501242732-project] Request method failure captured: Aug 31 01:29:31.293533 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: request: GET /compute/v2.1/os-volumes/91502d6a-a014-4dfc-b10e-25bf73a157fd HTTP/1.1 Aug 31 01:29:31.293533 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept: application/json Aug 31 01:29:31.293533 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept-Encoding: identity Aug 31 01:29:31.293533 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Connection: close Aug 31 01:29:31.293533 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Length: 0 Aug 31 01:29:31.293533 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Type: application/json Aug 31 01:29:31.293533 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Host: 10.222.0.20 Aug 31 01:29:31.293533 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Openstack-System-Scope: None Aug 31 01:29:31.293533 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: User-Agent: python-urllib3/1.26.12 Aug 31 01:29:31.293533 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Auth-Token: gAAAAABjDrl24BRNApRpE3Erhe-MwsCjg6e4OXmFlx77A9QQjft4ve6Qv-1gYiwwIkAoTNUBRqoA-C06Kf6779oLSe7_W7bH1qG0B17HL7HHk7Mw6PuyOHPXZhYyDe34eMYuRHa-JAmxifDTIIoHjlzT2iJPxknv5IqLoFwfN8jycdndbhL3s48 Aug 31 01:29:31.293533 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Id: None Aug 31 01:29:31.293533 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Name: None Aug 31 01:29:31.293533 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Identity-Status: Confirmed Aug 31 01:29:31.293533 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Is-Admin-Project: True Aug 31 01:29:31.293533 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Id: default Aug 31 01:29:31.293533 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Name: Default Aug 31 01:29:31.293533 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Id: 1572b045b5614756849f3f7212b688f7 Aug 31 01:29:31.293533 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Name: tempest-VolumesGetTestJSON-501242732 Aug 31 01:29:31.293533 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Role: member,reader Aug 31 01:29:31.293533 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Roles: member,reader Aug 31 01:29:31.295170 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1572b045b5614756849f3f7212b688f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1572b045b5614756849f3f7212b688f7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1572b045b5614756849f3f7212b688f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1572b045b5614756849f3f7212b688f7"}]}] Aug 31 01:29:31.295170 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant: tempest-VolumesGetTestJSON-501242732 Aug 31 01:29:31.295170 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Id: 1572b045b5614756849f3f7212b688f7 Aug 31 01:29:31.295170 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Name: tempest-VolumesGetTestJSON-501242732 Aug 31 01:29:31.295170 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User: tempest-VolumesGetTestJSON-501242732-project Aug 31 01:29:31.295170 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Id: default Aug 31 01:29:31.295170 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Name: Default Aug 31 01:29:31.295170 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Id: 388a8b225f094fceb021e6db0cd88a41 Aug 31 01:29:31.295170 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Name: tempest-VolumesGetTestJSON-501242732-project Aug 31 01:29:31.295170 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: method: Aug 31 01:29:31.295170 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: exception: Volume 91502d6a-a014-4dfc-b10e-25bf73a157fd could not be found. Aug 31 01:29:31.295170 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: action_args: {'id': '91502d6a-a014-4dfc-b10e-25bf73a157fd'} Aug 31 01:29:31.295170 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:29:31.296061 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:31.296061 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 01:29:31.296061 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 01:29:31.296061 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 01:29:31.296061 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 01:29:31.296061 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 01:29:31.296061 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 01:29:31.296061 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 01:29:31.296061 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 01:29:31.296061 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 01:29:31.296061 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 01:29:31.296061 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 01:29:31.296061 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 01:29:31.296061 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 01:29:31.296061 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 01:29:31.296061 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 91502d6a-a014-4dfc-b10e-25bf73a157fd could not be found. (HTTP 404) (Request-ID: req-79f1bd0e-d756-4408-81ec-4894e3079b27) Aug 31 01:29:31.296061 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:31.296061 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:31.296061 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:31.297723 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:31.297723 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 01:29:31.297723 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 01:29:31.297723 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 01:29:31.297723 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 01:29:31.297723 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 01:29:31.297723 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 01:29:31.297723 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 01:29:31.297723 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 01:29:31.297723 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 01:29:31.297723 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 01:29:31.297723 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 01:29:31.297723 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 01:29:31.297723 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 01:29:31.297723 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 01:29:31.297723 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 01:29:31.297723 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 01:29:31.297723 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 01:29:31.297723 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 01:29:31.299413 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 01:29:31.299413 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 01:29:31.299413 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 01:29:31.299413 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 01:29:31.299413 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 91502d6a-a014-4dfc-b10e-25bf73a157fd could not be found. Aug 31 01:29:31.299413 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:31.299413 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:31.299413 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:31.299413 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:31.299413 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:31.299413 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:31.299413 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:29:31.299413 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:29:31.299413 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 01:29:31.299413 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 01:29:31.299413 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:29:31.299413 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:29:31.299413 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 01:29:31.299413 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:29:31.301119 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 91502d6a-a014-4dfc-b10e-25bf73a157fd could not be found. Aug 31 01:29:31.301119 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:31.301119 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:31.301119 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:31.301119 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:31.301119 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:31.301119 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:31.301119 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:29:31.301119 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:29:31.301119 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 91502d6a-a014-4dfc-b10e-25bf73a157fd could not be found. Aug 31 01:29:31.301119 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:31.301119 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-7b5a16fe-ac59-4da6-b8d3-e4e918732e74 tempest-VolumesGetTestJSON-501242732 tempest-VolumesGetTestJSON-501242732-project] Returning 404 to user: Volume 91502d6a-a014-4dfc-b10e-25bf73a157fd could not be found. {{(pid=121025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:29:31.301119 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-7b5a16fe-ac59-4da6-b8d3-e4e918732e74 tempest-VolumesGetTestJSON-501242732 tempest-VolumesGetTestJSON-501242732-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/91502d6a-a014-4dfc-b10e-25bf73a157fd" status: 404 len: 109 microversion: 2.1 time: 0.037471 Aug 31 01:29:31.301119 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 410/807] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 31 01:29:31 2022] GET /compute/v2.1/os-volumes/91502d6a-a014-4dfc-b10e-25bf73a157fd => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:29:31.307658 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-a45c2ba4-cf01-441e-a3e0-659f30f864d5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:31.308773 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-a45c2ba4-cf01-441e-a3e0-659f30f864d5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:31.315985 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a45c2ba4-cf01-441e-a3e0-659f30f864d5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:31.316477 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a45c2ba4-cf01-441e-a3e0-659f30f864d5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:31.316953 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a45c2ba4-cf01-441e-a3e0-659f30f864d5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:31.317659 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a45c2ba4-cf01-441e-a3e0-659f30f864d5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:31.319125 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a45c2ba4-cf01-441e-a3e0-659f30f864d5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:31.319243 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a45c2ba4-cf01-441e-a3e0-659f30f864d5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:31.451444 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-a45c2ba4-cf01-441e-a3e0-659f30f864d5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:29:31.459660 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-a45c2ba4-cf01-441e-a3e0-659f30f864d5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:29:31.461192 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-a45c2ba4-cf01-441e-a3e0-659f30f864d5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:29:31.462341 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-a45c2ba4-cf01-441e-a3e0-659f30f864d5 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1722 microversion: 2.20 time: 0.158546 Aug 31 01:29:31.462894 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 398/808] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:29:31 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:29:32.486531 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-108b73bf-2469-4d08-a6b9-e9e43dbc02b0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:32.487140 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-108b73bf-2469-4d08-a6b9-e9e43dbc02b0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:32.493551 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-108b73bf-2469-4d08-a6b9-e9e43dbc02b0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:32.494044 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-108b73bf-2469-4d08-a6b9-e9e43dbc02b0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:32.494485 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-108b73bf-2469-4d08-a6b9-e9e43dbc02b0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:32.495353 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-108b73bf-2469-4d08-a6b9-e9e43dbc02b0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:32.495807 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-108b73bf-2469-4d08-a6b9-e9e43dbc02b0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:32.496426 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-108b73bf-2469-4d08-a6b9-e9e43dbc02b0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:32.580539 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-108b73bf-2469-4d08-a6b9-e9e43dbc02b0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:29:32.590428 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-108b73bf-2469-4d08-a6b9-e9e43dbc02b0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:29:32.591855 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-108b73bf-2469-4d08-a6b9-e9e43dbc02b0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:29:32.593066 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-108b73bf-2469-4d08-a6b9-e9e43dbc02b0 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1655 microversion: 2.20 time: 0.111614 Aug 31 01:29:32.593630 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 411/809] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:29:32 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1655 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:29:32.696888 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [req-8b0648ed-94c8-493a-b9b5-63cad67d3a99 req-a25fb873-d64d-46ff-bdc7-f35ec342278f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7311a59-7d10-4edb-be41-f6872e563e09", "name": "network-vif-deleted", "tag": "1302084d-99f4-4cd1-8b6d-4a829a883993"}]} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:29:32.712188 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-8b0648ed-94c8-493a-b9b5-63cad67d3a99 req-a25fb873-d64d-46ff-bdc7-f35ec342278f service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:32.712975 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-8b0648ed-94c8-493a-b9b5-63cad67d3a99 req-a25fb873-d64d-46ff-bdc7-f35ec342278f service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:32.713610 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-8b0648ed-94c8-493a-b9b5-63cad67d3a99 req-a25fb873-d64d-46ff-bdc7-f35ec342278f service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:32.725640 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.compute.server_external_events [req-8b0648ed-94c8-493a-b9b5-63cad67d3a99 req-a25fb873-d64d-46ff-bdc7-f35ec342278f service nova] Creating event network-vif-deleted:1302084d-99f4-4cd1-8b6d-4a829a883993 for instance b7311a59-7d10-4edb-be41-f6872e563e09 on hv-cinder-85528 Aug 31 01:29:32.731835 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [req-8b0648ed-94c8-493a-b9b5-63cad67d3a99 req-a25fb873-d64d-46ff-bdc7-f35ec342278f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039412 Aug 31 01:29:32.733140 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 399/810] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:29:33.617549 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-0d38c588-6cbb-4eb5-83bc-71a6a1146dd1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:33.618225 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-0d38c588-6cbb-4eb5-83bc-71a6a1146dd1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:33.624836 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0d38c588-6cbb-4eb5-83bc-71a6a1146dd1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:33.625328 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0d38c588-6cbb-4eb5-83bc-71a6a1146dd1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:33.625949 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0d38c588-6cbb-4eb5-83bc-71a6a1146dd1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:33.626657 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0d38c588-6cbb-4eb5-83bc-71a6a1146dd1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:33.627111 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0d38c588-6cbb-4eb5-83bc-71a6a1146dd1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:33.627525 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0d38c588-6cbb-4eb5-83bc-71a6a1146dd1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:33.704012 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-0d38c588-6cbb-4eb5-83bc-71a6a1146dd1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:29:33.715337 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-0d38c588-6cbb-4eb5-83bc-71a6a1146dd1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:29:33.717076 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-0d38c588-6cbb-4eb5-83bc-71a6a1146dd1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:29:33.718342 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-0d38c588-6cbb-4eb5-83bc-71a6a1146dd1 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1365 microversion: 2.20 time: 0.105498 Aug 31 01:29:33.718992 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 412/811] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:29:33 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1365 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:29:34.743647 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-74f50f0b-832e-48ff-af8d-9ba7ddcfcc23 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:34.744445 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-74f50f0b-832e-48ff-af8d-9ba7ddcfcc23 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:34.750663 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-74f50f0b-832e-48ff-af8d-9ba7ddcfcc23 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:34.751150 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-74f50f0b-832e-48ff-af8d-9ba7ddcfcc23 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:34.751591 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-74f50f0b-832e-48ff-af8d-9ba7ddcfcc23 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:34.752325 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-74f50f0b-832e-48ff-af8d-9ba7ddcfcc23 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:34.752806 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-74f50f0b-832e-48ff-af8d-9ba7ddcfcc23 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:34.753232 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-74f50f0b-832e-48ff-af8d-9ba7ddcfcc23 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:34.816021 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-74f50f0b-832e-48ff-af8d-9ba7ddcfcc23 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:29:34.824211 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-74f50f0b-832e-48ff-af8d-9ba7ddcfcc23 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:29:34.825689 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-74f50f0b-832e-48ff-af8d-9ba7ddcfcc23 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:29:34.826946 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-74f50f0b-832e-48ff-af8d-9ba7ddcfcc23 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1365 microversion: 2.20 time: 0.088553 Aug 31 01:29:34.827514 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 400/812] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:29:34 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1365 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:29:35.848952 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-e572aac1-41cc-46b0-90cd-672df3b93cf7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:35.849562 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-e572aac1-41cc-46b0-90cd-672df3b93cf7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:35.855969 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e572aac1-41cc-46b0-90cd-672df3b93cf7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:35.856449 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e572aac1-41cc-46b0-90cd-672df3b93cf7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:35.856970 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e572aac1-41cc-46b0-90cd-672df3b93cf7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:35.857642 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e572aac1-41cc-46b0-90cd-672df3b93cf7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:35.858110 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e572aac1-41cc-46b0-90cd-672df3b93cf7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:35.858515 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e572aac1-41cc-46b0-90cd-672df3b93cf7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:35.889504 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e572aac1-41cc-46b0-90cd-672df3b93cf7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:35.889981 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e572aac1-41cc-46b0-90cd-672df3b93cf7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:35.890412 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e572aac1-41cc-46b0-90cd-672df3b93cf7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:35.890859 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.objects.instance [None req-e572aac1-41cc-46b0-90cd-672df3b93cf7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lazy-loading 'fault' on Instance uuid b7311a59-7d10-4edb-be41-f6872e563e09 {{(pid=121025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:29:35.931686 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-e572aac1-41cc-46b0-90cd-672df3b93cf7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:29:35.938860 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-e572aac1-41cc-46b0-90cd-672df3b93cf7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:29:35.940290 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-e572aac1-41cc-46b0-90cd-672df3b93cf7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efaf57b6482149ca86a9bba26d7654f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d2295ada114ea3b6b5001c4c197f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:29:35.941486 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-e572aac1-41cc-46b0-90cd-672df3b93cf7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 200 len: 1370 microversion: 2.20 time: 0.096539 Aug 31 01:29:35.942038 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 413/813] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:29:35 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 1370 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:29:36.967048 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-ff2b4f74-a0aa-406c-88f7-5eb50fae3eba tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:36.967753 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-ff2b4f74-a0aa-406c-88f7-5eb50fae3eba tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:36.974410 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ff2b4f74-a0aa-406c-88f7-5eb50fae3eba tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:36.975433 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ff2b4f74-a0aa-406c-88f7-5eb50fae3eba tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:36.975875 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ff2b4f74-a0aa-406c-88f7-5eb50fae3eba tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:36.976636 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ff2b4f74-a0aa-406c-88f7-5eb50fae3eba tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:36.977122 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ff2b4f74-a0aa-406c-88f7-5eb50fae3eba tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:36.977552 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ff2b4f74-a0aa-406c-88f7-5eb50fae3eba tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:36.990937 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.wsgi [None req-ff2b4f74-a0aa-406c-88f7-5eb50fae3eba tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] HTTP exception thrown: Instance b7311a59-7d10-4edb-be41-f6872e563e09 could not be found. Aug 31 01:29:36.992698 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-ff2b4f74-a0aa-406c-88f7-5eb50fae3eba tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Request method failure captured: Aug 31 01:29:36.992698 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: request: GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 HTTP/1.1 Aug 31 01:29:36.992698 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept: application/json Aug 31 01:29:36.992698 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept-Encoding: identity Aug 31 01:29:36.992698 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Connection: close Aug 31 01:29:36.992698 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Length: 0 Aug 31 01:29:36.992698 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Type: application/json Aug 31 01:29:36.992698 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Host: 10.222.0.20 Aug 31 01:29:36.992698 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Openstack-System-Scope: None Aug 31 01:29:36.992698 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: User-Agent: python-urllib3/1.26.12 Aug 31 01:29:36.992698 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Auth-Token: gAAAAABjDrffHmfquHpU5iPLBs8FDqKutfRVUEUxPEzIj0Biqy4NiVdTblyb_LDRMjmFG2KnARTgH9N7iw65iz55bAnno_TG-r0IIyCJrmIG-kh9BBgEXVLL4dd0AsyK4XngDiiyOKQ1ueozOf6oXBeisdXLVvuDqJvQku7RoTCOErpOkdm1MG4 Aug 31 01:29:36.992698 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Id: None Aug 31 01:29:36.992698 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Name: None Aug 31 01:29:36.992698 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Identity-Status: Confirmed Aug 31 01:29:36.992698 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Is-Admin-Project: True Aug 31 01:29:36.992698 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 01:29:36.992698 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Id: default Aug 31 01:29:36.992698 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Name: Default Aug 31 01:29:36.992698 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Id: 53d2295ada114ea3b6b5001c4c197f35 Aug 31 01:29:36.992698 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1916258718 Aug 31 01:29:36.992698 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Role: member,reader Aug 31 01:29:36.992698 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Roles: member,reader Aug 31 01:29:36.994276 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/53d2295ada114ea3b6b5001c4c197f35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_53d2295ada114ea3b6b5001c4c197f35", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/53d2295ada114ea3b6b5001c4c197f35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/53d2295ada114ea3b6b5001c4c197f35"}]}] Aug 31 01:29:36.994276 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1916258718 Aug 31 01:29:36.994276 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Id: 53d2295ada114ea3b6b5001c4c197f35 Aug 31 01:29:36.994276 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1916258718 Aug 31 01:29:36.994276 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User: tempest-AttachVolumeShelveTestJSON-1916258718-project Aug 31 01:29:36.994276 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Id: default Aug 31 01:29:36.994276 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Name: Default Aug 31 01:29:36.994276 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Id: efaf57b6482149ca86a9bba26d7654f2 Aug 31 01:29:36.994276 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1916258718-project Aug 31 01:29:36.994276 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: method: > Aug 31 01:29:36.994276 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: exception: Instance b7311a59-7d10-4edb-be41-f6872e563e09 could not be found. Aug 31 01:29:36.994276 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: action_args: {'id': 'b7311a59-7d10-4edb-be41-f6872e563e09'} Aug 31 01:29:36.998638 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:29:36.998638 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:36.998638 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:29:36.998638 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:29:36.998638 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:29:36.998638 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:29:36.998638 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:29:36.998638 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:29:36.998638 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:29:36.998638 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:29:36.998638 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7311a59-7d10-4edb-be41-f6872e563e09 could not be found. Aug 31 01:29:36.998638 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:36.998638 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:36.998638 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:36.998638 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:36.998638 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:36.998638 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:36.998638 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:29:36.998638 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:29:36.998638 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:29:37.000050 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:29:37.000050 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:29:37.000050 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:29:37.000050 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:29:37.000050 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:29:37.000050 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:29:37.000050 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:29:37.000050 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7311a59-7d10-4edb-be41-f6872e563e09 could not be found. Aug 31 01:29:37.000050 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:37.000050 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:37.000050 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:37.000050 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:37.000050 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:37.000050 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:37.000050 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:29:37.000050 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:29:37.000050 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7311a59-7d10-4edb-be41-f6872e563e09 could not be found. Aug 31 01:29:37.000050 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:37.001396 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-ff2b4f74-a0aa-406c-88f7-5eb50fae3eba tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Returning 404 to user: Instance b7311a59-7d10-4edb-be41-f6872e563e09 could not be found. {{(pid=121026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:29:37.001396 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-ff2b4f74-a0aa-406c-88f7-5eb50fae3eba tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 404 len: 111 microversion: 2.20 time: 0.031078 Aug 31 01:29:37.001396 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 401/814] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:29:36 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 01:29:37.002997 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-b1ed5de4-2949-4692-9234-a944e712d157 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '.version_select at 0x7f1fe15120d0>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:37.081730 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-b1ed5de4-2949-4692-9234-a944e712d157 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-884793689" status: 204 len: 0 microversion: 2.20 time: 0.082357 Aug 31 01:29:37.082321 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 414/815] 10.222.0.20 () {60 vars in 1259 bytes} [Wed Aug 31 01:29:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-884793689 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 01:29:37.397455 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-88d47fd5-aa95-4cc3-ba38-70c329c534d2 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:29:37.399775 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-88d47fd5-aa95-4cc3-ba38-70c329c534d2 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:37.405695 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-88d47fd5-aa95-4cc3-ba38-70c329c534d2 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:37.406201 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-88d47fd5-aa95-4cc3-ba38-70c329c534d2 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:37.406695 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-88d47fd5-aa95-4cc3-ba38-70c329c534d2 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:37.407311 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-88d47fd5-aa95-4cc3-ba38-70c329c534d2 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:37.407766 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-88d47fd5-aa95-4cc3-ba38-70c329c534d2 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:37.408360 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-88d47fd5-aa95-4cc3-ba38-70c329c534d2 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:37.838793 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-88d47fd5-aa95-4cc3-ba38-70c329c534d2 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "POST /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d/action" status: 202 len: 0 microversion: 2.1 time: 0.445204 Aug 31 01:29:37.839419 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 402/816] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 31 01:29:37 2022] POST /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d/action => generated 0 bytes in 447 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 01:29:37.847452 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-8ad247b9-785a-4fb0-a691-4164fa6673c9 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:37.852321 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-8ad247b9-785a-4fb0-a691-4164fa6673c9 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:37.854580 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8ad247b9-785a-4fb0-a691-4164fa6673c9 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:37.855068 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8ad247b9-785a-4fb0-a691-4164fa6673c9 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:37.855521 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8ad247b9-785a-4fb0-a691-4164fa6673c9 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:37.856196 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8ad247b9-785a-4fb0-a691-4164fa6673c9 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:37.856650 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8ad247b9-785a-4fb0-a691-4164fa6673c9 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:37.857098 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8ad247b9-785a-4fb0-a691-4164fa6673c9 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:38.033290 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-8ad247b9-785a-4fb0-a691-4164fa6673c9 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:29:38.043911 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-8ad247b9-785a-4fb0-a691-4164fa6673c9 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1754 microversion: 2.1 time: 0.200278 Aug 31 01:29:38.052898 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 415/817] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:29:37 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1754 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:29:39.067741 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-7dd2b39d-bbde-4e2a-9897-8320840d1b59 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:39.068501 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-7dd2b39d-bbde-4e2a-9897-8320840d1b59 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:39.075984 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7dd2b39d-bbde-4e2a-9897-8320840d1b59 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:39.076472 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7dd2b39d-bbde-4e2a-9897-8320840d1b59 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:39.076968 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7dd2b39d-bbde-4e2a-9897-8320840d1b59 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:39.077662 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7dd2b39d-bbde-4e2a-9897-8320840d1b59 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:39.078111 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7dd2b39d-bbde-4e2a-9897-8320840d1b59 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:39.078536 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7dd2b39d-bbde-4e2a-9897-8320840d1b59 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:39.229398 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-7dd2b39d-bbde-4e2a-9897-8320840d1b59 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:29:39.237627 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-7dd2b39d-bbde-4e2a-9897-8320840d1b59 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1754 microversion: 2.1 time: 0.175160 Aug 31 01:29:39.238180 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 403/818] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:29:39 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:29:39.587452 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-6f658a54-de0a-4edd-a387-8ac63a0c1054 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:39.588022 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-6f658a54-de0a-4edd-a387-8ac63a0c1054 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:39.594860 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6f658a54-de0a-4edd-a387-8ac63a0c1054 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:39.596030 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6f658a54-de0a-4edd-a387-8ac63a0c1054 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:39.596030 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6f658a54-de0a-4edd-a387-8ac63a0c1054 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:39.596420 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6f658a54-de0a-4edd-a387-8ac63a0c1054 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:39.596900 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6f658a54-de0a-4edd-a387-8ac63a0c1054 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:39.597322 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6f658a54-de0a-4edd-a387-8ac63a0c1054 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:39.610773 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.wsgi [None req-6f658a54-de0a-4edd-a387-8ac63a0c1054 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] HTTP exception thrown: Instance b7311a59-7d10-4edb-be41-f6872e563e09 could not be found. Aug 31 01:29:39.612344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-6f658a54-de0a-4edd-a387-8ac63a0c1054 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Request method failure captured: Aug 31 01:29:39.612344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: request: DELETE /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 HTTP/1.1 Aug 31 01:29:39.612344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept: application/json Aug 31 01:29:39.612344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept-Encoding: identity Aug 31 01:29:39.612344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Connection: close Aug 31 01:29:39.612344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Length: 0 Aug 31 01:29:39.612344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Type: application/json Aug 31 01:29:39.612344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Host: 10.222.0.20 Aug 31 01:29:39.612344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Openstack-System-Scope: None Aug 31 01:29:39.612344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: User-Agent: python-urllib3/1.26.12 Aug 31 01:29:39.612344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Auth-Token: gAAAAABjDrffHmfquHpU5iPLBs8FDqKutfRVUEUxPEzIj0Biqy4NiVdTblyb_LDRMjmFG2KnARTgH9N7iw65iz55bAnno_TG-r0IIyCJrmIG-kh9BBgEXVLL4dd0AsyK4XngDiiyOKQ1ueozOf6oXBeisdXLVvuDqJvQku7RoTCOErpOkdm1MG4 Aug 31 01:29:39.612344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Id: None Aug 31 01:29:39.612344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Name: None Aug 31 01:29:39.612344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Identity-Status: Confirmed Aug 31 01:29:39.612344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Is-Admin-Project: True Aug 31 01:29:39.612344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 01:29:39.612344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Id: default Aug 31 01:29:39.612344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Name: Default Aug 31 01:29:39.612344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Id: 53d2295ada114ea3b6b5001c4c197f35 Aug 31 01:29:39.612344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1916258718 Aug 31 01:29:39.612344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Role: member,reader Aug 31 01:29:39.612344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Roles: member,reader Aug 31 01:29:39.614085 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/53d2295ada114ea3b6b5001c4c197f35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_53d2295ada114ea3b6b5001c4c197f35", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/53d2295ada114ea3b6b5001c4c197f35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/53d2295ada114ea3b6b5001c4c197f35"}]}] Aug 31 01:29:39.614085 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1916258718 Aug 31 01:29:39.614085 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Id: 53d2295ada114ea3b6b5001c4c197f35 Aug 31 01:29:39.614085 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1916258718 Aug 31 01:29:39.614085 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User: tempest-AttachVolumeShelveTestJSON-1916258718-project Aug 31 01:29:39.614085 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Id: default Aug 31 01:29:39.614085 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Name: Default Aug 31 01:29:39.614085 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Id: efaf57b6482149ca86a9bba26d7654f2 Aug 31 01:29:39.614085 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1916258718-project Aug 31 01:29:39.614085 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: method: > Aug 31 01:29:39.614085 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: exception: Instance b7311a59-7d10-4edb-be41-f6872e563e09 could not be found. Aug 31 01:29:39.614085 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: action_args: {'id': 'b7311a59-7d10-4edb-be41-f6872e563e09'} Aug 31 01:29:39.615142 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:29:39.615142 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:39.615142 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:29:39.615142 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:29:39.615142 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:29:39.615142 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:29:39.615142 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:29:39.615142 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:29:39.615142 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:29:39.615142 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:29:39.615142 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7311a59-7d10-4edb-be41-f6872e563e09 could not be found. Aug 31 01:29:39.615142 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:39.615142 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:39.615142 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:39.615142 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:39.615142 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:39.615142 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:39.615142 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:29:39.615142 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:29:39.615142 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:29:39.616648 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:29:39.616648 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 01:29:39.616648 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 01:29:39.616648 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 01:29:39.616648 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 01:29:39.616648 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:29:39.616648 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:29:39.616648 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:29:39.616648 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:29:39.616648 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7311a59-7d10-4edb-be41-f6872e563e09 could not be found. Aug 31 01:29:39.616648 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:39.616648 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:39.616648 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:39.616648 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:39.616648 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:39.616648 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:39.616648 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:29:39.616648 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:29:39.616648 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7311a59-7d10-4edb-be41-f6872e563e09 could not be found. Aug 31 01:29:39.616648 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:39.619005 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-6f658a54-de0a-4edd-a387-8ac63a0c1054 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Returning 404 to user: Instance b7311a59-7d10-4edb-be41-f6872e563e09 could not be found. {{(pid=121025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:29:39.619005 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-6f658a54-de0a-4edd-a387-8ac63a0c1054 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 404 len: 111 microversion: 2.20 time: 0.031410 Aug 31 01:29:39.619005 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 416/819] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Aug 31 01:29:39 2022] DELETE /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 01:29:39.622833 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-14b32e74-bf4b-4888-bb39-bcb028101ccd tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:39.632767 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-14b32e74-bf4b-4888-bb39-bcb028101ccd tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: b7311a59-7d10-4edb-be41-f6872e563e09] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:39.632767 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-14b32e74-bf4b-4888-bb39-bcb028101ccd tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:39.632767 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-14b32e74-bf4b-4888-bb39-bcb028101ccd tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:39.632767 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-14b32e74-bf4b-4888-bb39-bcb028101ccd tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:39.633709 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-14b32e74-bf4b-4888-bb39-bcb028101ccd tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:39.633709 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-14b32e74-bf4b-4888-bb39-bcb028101ccd tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:39.633709 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-14b32e74-bf4b-4888-bb39-bcb028101ccd tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:39.645470 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.wsgi [None req-14b32e74-bf4b-4888-bb39-bcb028101ccd tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] HTTP exception thrown: Instance b7311a59-7d10-4edb-be41-f6872e563e09 could not be found. Aug 31 01:29:39.647085 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-14b32e74-bf4b-4888-bb39-bcb028101ccd tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Request method failure captured: Aug 31 01:29:39.647085 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: request: GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 HTTP/1.1 Aug 31 01:29:39.647085 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept: application/json Aug 31 01:29:39.647085 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept-Encoding: identity Aug 31 01:29:39.647085 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Connection: close Aug 31 01:29:39.647085 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Length: 0 Aug 31 01:29:39.647085 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Type: application/json Aug 31 01:29:39.647085 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Host: 10.222.0.20 Aug 31 01:29:39.647085 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Openstack-System-Scope: None Aug 31 01:29:39.647085 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: User-Agent: python-urllib3/1.26.12 Aug 31 01:29:39.647085 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Auth-Token: gAAAAABjDrffHmfquHpU5iPLBs8FDqKutfRVUEUxPEzIj0Biqy4NiVdTblyb_LDRMjmFG2KnARTgH9N7iw65iz55bAnno_TG-r0IIyCJrmIG-kh9BBgEXVLL4dd0AsyK4XngDiiyOKQ1ueozOf6oXBeisdXLVvuDqJvQku7RoTCOErpOkdm1MG4 Aug 31 01:29:39.647085 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Id: None Aug 31 01:29:39.647085 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Name: None Aug 31 01:29:39.647085 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Identity-Status: Confirmed Aug 31 01:29:39.647085 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Is-Admin-Project: True Aug 31 01:29:39.647085 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 01:29:39.647085 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Id: default Aug 31 01:29:39.647085 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Name: Default Aug 31 01:29:39.647085 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Id: 53d2295ada114ea3b6b5001c4c197f35 Aug 31 01:29:39.647085 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1916258718 Aug 31 01:29:39.647085 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Role: member,reader Aug 31 01:29:39.647085 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Roles: member,reader Aug 31 01:29:39.648764 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/53d2295ada114ea3b6b5001c4c197f35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_53d2295ada114ea3b6b5001c4c197f35", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/53d2295ada114ea3b6b5001c4c197f35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/53d2295ada114ea3b6b5001c4c197f35"}]}] Aug 31 01:29:39.648764 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1916258718 Aug 31 01:29:39.648764 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Id: 53d2295ada114ea3b6b5001c4c197f35 Aug 31 01:29:39.648764 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1916258718 Aug 31 01:29:39.648764 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User: tempest-AttachVolumeShelveTestJSON-1916258718-project Aug 31 01:29:39.648764 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Id: default Aug 31 01:29:39.648764 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Name: Default Aug 31 01:29:39.648764 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Id: efaf57b6482149ca86a9bba26d7654f2 Aug 31 01:29:39.648764 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1916258718-project Aug 31 01:29:39.648764 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: method: > Aug 31 01:29:39.648764 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: exception: Instance b7311a59-7d10-4edb-be41-f6872e563e09 could not be found. Aug 31 01:29:39.648764 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: action_args: {'id': 'b7311a59-7d10-4edb-be41-f6872e563e09'} Aug 31 01:29:39.649754 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:29:39.649754 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:39.649754 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:29:39.649754 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:29:39.649754 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:29:39.649754 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:29:39.649754 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:29:39.649754 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:29:39.649754 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:29:39.649754 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:29:39.649754 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7311a59-7d10-4edb-be41-f6872e563e09 could not be found. Aug 31 01:29:39.649754 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:39.649754 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:39.649754 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:39.649754 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:39.649754 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:39.649754 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:39.649754 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:29:39.649754 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:29:39.649754 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:29:39.651219 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:29:39.651219 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:29:39.651219 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:29:39.651219 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:29:39.651219 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:29:39.651219 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:29:39.651219 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:29:39.651219 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7311a59-7d10-4edb-be41-f6872e563e09 could not be found. Aug 31 01:29:39.651219 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:39.651219 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:39.651219 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:39.651219 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:39.651219 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:39.651219 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:39.651219 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:29:39.651219 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:29:39.651219 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7311a59-7d10-4edb-be41-f6872e563e09 could not be found. Aug 31 01:29:39.651219 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:29:39.652469 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-14b32e74-bf4b-4888-bb39-bcb028101ccd tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Returning 404 to user: Instance b7311a59-7d10-4edb-be41-f6872e563e09 could not be found. {{(pid=121026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:29:39.652469 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-14b32e74-bf4b-4888-bb39-bcb028101ccd tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09" status: 404 len: 111 microversion: 2.20 time: 0.029522 Aug 31 01:29:39.652469 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 404/820] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:29:39 2022] GET /compute/v2.1/servers/b7311a59-7d10-4edb-be41-f6872e563e09 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 31 01:29:40.259177 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-8026b0e8-b6da-4200-b685-ad1d9c106db5 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:40.259820 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-8026b0e8-b6da-4200-b685-ad1d9c106db5 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:40.265881 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8026b0e8-b6da-4200-b685-ad1d9c106db5 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:40.266359 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8026b0e8-b6da-4200-b685-ad1d9c106db5 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:40.266791 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8026b0e8-b6da-4200-b685-ad1d9c106db5 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:40.267471 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8026b0e8-b6da-4200-b685-ad1d9c106db5 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:40.267922 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8026b0e8-b6da-4200-b685-ad1d9c106db5 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:40.268344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8026b0e8-b6da-4200-b685-ad1d9c106db5 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:40.407606 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-8026b0e8-b6da-4200-b685-ad1d9c106db5 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:29:40.416494 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-8026b0e8-b6da-4200-b685-ad1d9c106db5 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1759 microversion: 2.1 time: 0.161481 Aug 31 01:29:40.417089 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 417/821] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:29:40 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1759 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:29:41.437725 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-46635ca9-e3b8-465b-a32f-a99d746e1933 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:41.438357 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-46635ca9-e3b8-465b-a32f-a99d746e1933 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:41.444647 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-46635ca9-e3b8-465b-a32f-a99d746e1933 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:41.445812 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-46635ca9-e3b8-465b-a32f-a99d746e1933 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:41.446547 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-46635ca9-e3b8-465b-a32f-a99d746e1933 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:41.447564 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-46635ca9-e3b8-465b-a32f-a99d746e1933 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:41.448168 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-46635ca9-e3b8-465b-a32f-a99d746e1933 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:41.448590 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-46635ca9-e3b8-465b-a32f-a99d746e1933 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:41.451263 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:29:41.593649 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-46635ca9-e3b8-465b-a32f-a99d746e1933 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:29:41.602233 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-46635ca9-e3b8-465b-a32f-a99d746e1933 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1759 microversion: 2.1 time: 0.167870 Aug 31 01:29:41.602781 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 405/822] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:29:41 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1759 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:29:42.627595 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-f4652ed7-5e3d-495e-ad8e-1475dd05c301 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:42.628201 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-f4652ed7-5e3d-495e-ad8e-1475dd05c301 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:42.634638 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f4652ed7-5e3d-495e-ad8e-1475dd05c301 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:42.635117 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f4652ed7-5e3d-495e-ad8e-1475dd05c301 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:42.635554 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f4652ed7-5e3d-495e-ad8e-1475dd05c301 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:42.636234 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f4652ed7-5e3d-495e-ad8e-1475dd05c301 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:42.636685 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f4652ed7-5e3d-495e-ad8e-1475dd05c301 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:42.637136 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f4652ed7-5e3d-495e-ad8e-1475dd05c301 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:42.639729 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:29:42.780519 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-f4652ed7-5e3d-495e-ad8e-1475dd05c301 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:29:42.789805 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-f4652ed7-5e3d-495e-ad8e-1475dd05c301 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1759 microversion: 2.1 time: 0.165171 Aug 31 01:29:42.795096 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 418/823] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:29:42 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1759 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:29:43.811329 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-091896fc-13a9-408d-ae90-950b0ed17b5a tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:43.811942 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-091896fc-13a9-408d-ae90-950b0ed17b5a tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:43.818347 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-091896fc-13a9-408d-ae90-950b0ed17b5a tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:43.818824 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-091896fc-13a9-408d-ae90-950b0ed17b5a tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:43.819259 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-091896fc-13a9-408d-ae90-950b0ed17b5a tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:43.819938 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-091896fc-13a9-408d-ae90-950b0ed17b5a tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:43.820381 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-091896fc-13a9-408d-ae90-950b0ed17b5a tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:43.820822 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-091896fc-13a9-408d-ae90-950b0ed17b5a tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:43.963982 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-091896fc-13a9-408d-ae90-950b0ed17b5a tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:29:43.972392 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-091896fc-13a9-408d-ae90-950b0ed17b5a tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1759 microversion: 2.1 time: 0.164872 Aug 31 01:29:43.972777 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 406/824] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:29:43 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1759 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:29:44.993125 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-e1165824-ebf4-4eac-8c72-e63b40cb621e tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:44.993741 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-e1165824-ebf4-4eac-8c72-e63b40cb621e tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:44.996046 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:29:45.000895 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e1165824-ebf4-4eac-8c72-e63b40cb621e tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:45.001394 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e1165824-ebf4-4eac-8c72-e63b40cb621e tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:45.001828 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e1165824-ebf4-4eac-8c72-e63b40cb621e tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:45.002599 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e1165824-ebf4-4eac-8c72-e63b40cb621e tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:45.003057 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e1165824-ebf4-4eac-8c72-e63b40cb621e tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:45.003487 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e1165824-ebf4-4eac-8c72-e63b40cb621e tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:45.151643 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-e1165824-ebf4-4eac-8c72-e63b40cb621e tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:29:45.161097 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-e1165824-ebf4-4eac-8c72-e63b40cb621e tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1759 microversion: 2.1 time: 0.171620 Aug 31 01:29:45.161672 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 419/825] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:29:44 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1759 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:29:46.182679 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-225adba1-063d-43cf-a6ff-8b1e28dd3fe1 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:46.183289 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-225adba1-063d-43cf-a6ff-8b1e28dd3fe1 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:46.190302 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-225adba1-063d-43cf-a6ff-8b1e28dd3fe1 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:46.196374 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-b8c68256-343f-41cf-871f-edcff3415d44 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:46.197357 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-225adba1-063d-43cf-a6ff-8b1e28dd3fe1 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:46.197803 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-225adba1-063d-43cf-a6ff-8b1e28dd3fe1 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:46.198654 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-b8c68256-343f-41cf-871f-edcff3415d44 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:46.199745 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-225adba1-063d-43cf-a6ff-8b1e28dd3fe1 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:46.201377 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-225adba1-063d-43cf-a6ff-8b1e28dd3fe1 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:46.202015 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-225adba1-063d-43cf-a6ff-8b1e28dd3fe1 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:46.214854 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b8c68256-343f-41cf-871f-edcff3415d44 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:46.216073 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b8c68256-343f-41cf-871f-edcff3415d44 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:46.217249 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b8c68256-343f-41cf-871f-edcff3415d44 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:46.218612 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b8c68256-343f-41cf-871f-edcff3415d44 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:46.219852 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b8c68256-343f-41cf-871f-edcff3415d44 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:46.220554 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b8c68256-343f-41cf-871f-edcff3415d44 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:46.243286 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.wsgi [None req-b8c68256-343f-41cf-871f-edcff3415d44 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] HTTP exception thrown: Instance 12814f73-696a-4dc2-9182-7779bfe90ad5 could not be found. Aug 31 01:29:46.245179 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-b8c68256-343f-41cf-871f-edcff3415d44 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Request method failure captured: Aug 31 01:29:46.245179 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: request: DELETE /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 HTTP/1.1 Aug 31 01:29:46.245179 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept: application/json Aug 31 01:29:46.245179 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept-Encoding: identity Aug 31 01:29:46.245179 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Connection: close Aug 31 01:29:46.245179 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Length: 0 Aug 31 01:29:46.245179 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Type: application/json Aug 31 01:29:46.245179 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Host: 10.222.0.20 Aug 31 01:29:46.245179 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Openstack-System-Scope: None Aug 31 01:29:46.245179 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: User-Agent: python-urllib3/1.26.12 Aug 31 01:29:46.245179 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Auth-Token: gAAAAABjDrffHmfquHpU5iPLBs8FDqKutfRVUEUxPEzIj0Biqy4NiVdTblyb_LDRMjmFG2KnARTgH9N7iw65iz55bAnno_TG-r0IIyCJrmIG-kh9BBgEXVLL4dd0AsyK4XngDiiyOKQ1ueozOf6oXBeisdXLVvuDqJvQku7RoTCOErpOkdm1MG4 Aug 31 01:29:46.245179 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Id: None Aug 31 01:29:46.245179 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Name: None Aug 31 01:29:46.245179 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Identity-Status: Confirmed Aug 31 01:29:46.245179 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Is-Admin-Project: True Aug 31 01:29:46.245179 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 01:29:46.245179 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Id: default Aug 31 01:29:46.245179 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Name: Default Aug 31 01:29:46.245179 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Id: 53d2295ada114ea3b6b5001c4c197f35 Aug 31 01:29:46.245179 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1916258718 Aug 31 01:29:46.245179 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Role: member,reader Aug 31 01:29:46.245179 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Roles: member,reader Aug 31 01:29:46.247081 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/53d2295ada114ea3b6b5001c4c197f35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_53d2295ada114ea3b6b5001c4c197f35", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/53d2295ada114ea3b6b5001c4c197f35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/53d2295ada114ea3b6b5001c4c197f35"}]}] Aug 31 01:29:46.247081 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1916258718 Aug 31 01:29:46.247081 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Id: 53d2295ada114ea3b6b5001c4c197f35 Aug 31 01:29:46.247081 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1916258718 Aug 31 01:29:46.247081 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User: tempest-AttachVolumeShelveTestJSON-1916258718-project Aug 31 01:29:46.247081 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Id: default Aug 31 01:29:46.247081 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Name: Default Aug 31 01:29:46.247081 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Id: efaf57b6482149ca86a9bba26d7654f2 Aug 31 01:29:46.247081 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1916258718-project Aug 31 01:29:46.247081 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: method: > Aug 31 01:29:46.247081 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: exception: Instance 12814f73-696a-4dc2-9182-7779bfe90ad5 could not be found. Aug 31 01:29:46.247081 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: action_args: {'id': '12814f73-696a-4dc2-9182-7779bfe90ad5'} Aug 31 01:29:46.248013 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:29:46.248013 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:46.248013 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:29:46.248013 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:29:46.248013 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:29:46.248013 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:29:46.248013 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:29:46.248013 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:29:46.248013 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:29:46.248013 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:29:46.248013 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12814f73-696a-4dc2-9182-7779bfe90ad5 could not be found. Aug 31 01:29:46.248013 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:46.248013 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:46.248013 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:46.248013 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:46.248013 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:46.248013 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:46.248013 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:29:46.248013 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:29:46.248013 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:29:46.249548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:29:46.249548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 01:29:46.249548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 01:29:46.249548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 01:29:46.249548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 01:29:46.249548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:29:46.249548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:29:46.249548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:29:46.249548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:29:46.249548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12814f73-696a-4dc2-9182-7779bfe90ad5 could not be found. Aug 31 01:29:46.249548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:46.249548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:46.249548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:46.249548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:46.249548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:46.249548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:46.249548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:29:46.249548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:29:46.249548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12814f73-696a-4dc2-9182-7779bfe90ad5 could not be found. Aug 31 01:29:46.249548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:46.251489 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-b8c68256-343f-41cf-871f-edcff3415d44 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Returning 404 to user: Instance 12814f73-696a-4dc2-9182-7779bfe90ad5 could not be found. {{(pid=121025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:29:46.251489 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-b8c68256-343f-41cf-871f-edcff3415d44 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "DELETE /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 404 len: 111 microversion: 2.20 time: 0.055701 Aug 31 01:29:46.255633 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 420/826] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Aug 31 01:29:46 2022] DELETE /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 31 01:29:46.260634 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-44c726f4-315e-479b-aabf-887a3a5198d7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:46.261296 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-44c726f4-315e-479b-aabf-887a3a5198d7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] [instance: 12814f73-696a-4dc2-9182-7779bfe90ad5] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:46.270215 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-44c726f4-315e-479b-aabf-887a3a5198d7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:46.270836 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-44c726f4-315e-479b-aabf-887a3a5198d7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:46.271279 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-44c726f4-315e-479b-aabf-887a3a5198d7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:46.271998 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-44c726f4-315e-479b-aabf-887a3a5198d7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:46.272441 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-44c726f4-315e-479b-aabf-887a3a5198d7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:46.272898 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-44c726f4-315e-479b-aabf-887a3a5198d7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:46.374924 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-225adba1-063d-43cf-a6ff-8b1e28dd3fe1 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:29:46.383622 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-225adba1-063d-43cf-a6ff-8b1e28dd3fe1 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1759 microversion: 2.1 time: 0.204889 Aug 31 01:29:46.384205 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 407/827] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:29:46 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1759 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:29:46.445664 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.wsgi [None req-44c726f4-315e-479b-aabf-887a3a5198d7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] HTTP exception thrown: Instance 12814f73-696a-4dc2-9182-7779bfe90ad5 could not be found. Aug 31 01:29:46.448774 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-44c726f4-315e-479b-aabf-887a3a5198d7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Request method failure captured: Aug 31 01:29:46.448774 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: request: GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 HTTP/1.1 Aug 31 01:29:46.448774 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept: application/json Aug 31 01:29:46.448774 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept-Encoding: identity Aug 31 01:29:46.448774 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Connection: close Aug 31 01:29:46.448774 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Length: 0 Aug 31 01:29:46.448774 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Type: application/json Aug 31 01:29:46.448774 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Host: 10.222.0.20 Aug 31 01:29:46.448774 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Openstack-System-Scope: None Aug 31 01:29:46.448774 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: User-Agent: python-urllib3/1.26.12 Aug 31 01:29:46.448774 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Auth-Token: gAAAAABjDrffHmfquHpU5iPLBs8FDqKutfRVUEUxPEzIj0Biqy4NiVdTblyb_LDRMjmFG2KnARTgH9N7iw65iz55bAnno_TG-r0IIyCJrmIG-kh9BBgEXVLL4dd0AsyK4XngDiiyOKQ1ueozOf6oXBeisdXLVvuDqJvQku7RoTCOErpOkdm1MG4 Aug 31 01:29:46.448774 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Id: None Aug 31 01:29:46.448774 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Name: None Aug 31 01:29:46.448774 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Identity-Status: Confirmed Aug 31 01:29:46.448774 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Is-Admin-Project: True Aug 31 01:29:46.448774 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 01:29:46.448774 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Id: default Aug 31 01:29:46.448774 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Name: Default Aug 31 01:29:46.448774 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Id: 53d2295ada114ea3b6b5001c4c197f35 Aug 31 01:29:46.448774 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1916258718 Aug 31 01:29:46.448774 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Role: member,reader Aug 31 01:29:46.448774 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Roles: member,reader Aug 31 01:29:46.450466 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/53d2295ada114ea3b6b5001c4c197f35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_53d2295ada114ea3b6b5001c4c197f35", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/53d2295ada114ea3b6b5001c4c197f35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/53d2295ada114ea3b6b5001c4c197f35"}]}] Aug 31 01:29:46.450466 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1916258718 Aug 31 01:29:46.450466 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Id: 53d2295ada114ea3b6b5001c4c197f35 Aug 31 01:29:46.450466 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1916258718 Aug 31 01:29:46.450466 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User: tempest-AttachVolumeShelveTestJSON-1916258718-project Aug 31 01:29:46.450466 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Id: default Aug 31 01:29:46.450466 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Name: Default Aug 31 01:29:46.450466 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Id: efaf57b6482149ca86a9bba26d7654f2 Aug 31 01:29:46.450466 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1916258718-project Aug 31 01:29:46.450466 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: method: > Aug 31 01:29:46.450466 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: exception: Instance 12814f73-696a-4dc2-9182-7779bfe90ad5 could not be found. Aug 31 01:29:46.450466 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: action_args: {'id': '12814f73-696a-4dc2-9182-7779bfe90ad5'} Aug 31 01:29:46.451344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:29:46.451344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:46.451344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:29:46.451344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:29:46.451344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:29:46.451344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:29:46.451344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:29:46.451344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:29:46.451344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:29:46.451344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:29:46.451344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12814f73-696a-4dc2-9182-7779bfe90ad5 could not be found. Aug 31 01:29:46.451344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:46.451344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:46.451344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:46.451344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:46.451344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:46.451344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:46.451344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:29:46.451344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:29:46.451344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:29:46.452783 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:29:46.452783 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:29:46.452783 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:29:46.452783 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:29:46.452783 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:29:46.452783 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:29:46.452783 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:29:46.452783 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12814f73-696a-4dc2-9182-7779bfe90ad5 could not be found. Aug 31 01:29:46.452783 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:46.452783 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:29:46.452783 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:46.452783 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:29:46.452783 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:29:46.452783 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:29:46.452783 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:29:46.452783 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:29:46.452783 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12814f73-696a-4dc2-9182-7779bfe90ad5 could not be found. Aug 31 01:29:46.452783 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:29:46.454045 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-44c726f4-315e-479b-aabf-887a3a5198d7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] Returning 404 to user: Instance 12814f73-696a-4dc2-9182-7779bfe90ad5 could not be found. {{(pid=121025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:29:46.454045 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-44c726f4-315e-479b-aabf-887a3a5198d7 tempest-AttachVolumeShelveTestJSON-1916258718 tempest-AttachVolumeShelveTestJSON-1916258718-project] 10.222.0.20 "GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5" status: 404 len: 111 microversion: 2.20 time: 0.193685 Aug 31 01:29:46.454045 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 421/828] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 31 01:29:46 2022] GET /compute/v2.1/servers/12814f73-696a-4dc2-9182-7779bfe90ad5 => generated 111 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 01:29:47.406231 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-54a1f053-7b87-40a9-b4d2-fb2ff767a48b tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:47.406839 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-54a1f053-7b87-40a9-b4d2-fb2ff767a48b tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:47.413174 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-54a1f053-7b87-40a9-b4d2-fb2ff767a48b tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:47.413673 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-54a1f053-7b87-40a9-b4d2-fb2ff767a48b tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:47.414086 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-54a1f053-7b87-40a9-b4d2-fb2ff767a48b tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:47.414798 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-54a1f053-7b87-40a9-b4d2-fb2ff767a48b tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:47.415250 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-54a1f053-7b87-40a9-b4d2-fb2ff767a48b tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:47.415670 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-54a1f053-7b87-40a9-b4d2-fb2ff767a48b tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:47.635805 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-54a1f053-7b87-40a9-b4d2-fb2ff767a48b tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:29:47.647186 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-54a1f053-7b87-40a9-b4d2-fb2ff767a48b tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1759 microversion: 2.1 time: 0.244539 Aug 31 01:29:47.647891 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 408/829] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:29:47 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1759 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:29:48.668588 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-7550c111-26d0-4a9a-bec3-4fa8f45c406f tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:48.669252 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-7550c111-26d0-4a9a-bec3-4fa8f45c406f tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:48.675624 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7550c111-26d0-4a9a-bec3-4fa8f45c406f tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:48.676102 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7550c111-26d0-4a9a-bec3-4fa8f45c406f tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:48.676533 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7550c111-26d0-4a9a-bec3-4fa8f45c406f tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:48.677242 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7550c111-26d0-4a9a-bec3-4fa8f45c406f tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:48.677722 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7550c111-26d0-4a9a-bec3-4fa8f45c406f tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:48.682383 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7550c111-26d0-4a9a-bec3-4fa8f45c406f tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:49.280217 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-7550c111-26d0-4a9a-bec3-4fa8f45c406f tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:29:49.288391 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-7550c111-26d0-4a9a-bec3-4fa8f45c406f tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1759 microversion: 2.1 time: 0.624330 Aug 31 01:29:49.298020 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 422/830] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:29:48 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1759 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:29:50.310902 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-8eddddb5-b245-4006-aa8e-324d4799f579 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:50.318135 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-8eddddb5-b245-4006-aa8e-324d4799f579 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:50.318456 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8eddddb5-b245-4006-aa8e-324d4799f579 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:50.319027 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8eddddb5-b245-4006-aa8e-324d4799f579 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:50.319518 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8eddddb5-b245-4006-aa8e-324d4799f579 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:50.320134 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8eddddb5-b245-4006-aa8e-324d4799f579 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:50.320584 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8eddddb5-b245-4006-aa8e-324d4799f579 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:50.321019 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8eddddb5-b245-4006-aa8e-324d4799f579 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:50.493831 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-8eddddb5-b245-4006-aa8e-324d4799f579 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:29:50.502187 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-8eddddb5-b245-4006-aa8e-324d4799f579 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1759 microversion: 2.1 time: 0.195785 Aug 31 01:29:50.503031 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 409/831] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:29:50 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1759 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:29:51.523300 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-43e81d5f-ae8d-426a-94c5-56fc172220be tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:51.524487 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-43e81d5f-ae8d-426a-94c5-56fc172220be tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:51.531222 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-43e81d5f-ae8d-426a-94c5-56fc172220be tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:51.531796 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-43e81d5f-ae8d-426a-94c5-56fc172220be tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:51.532302 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-43e81d5f-ae8d-426a-94c5-56fc172220be tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:51.532990 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-43e81d5f-ae8d-426a-94c5-56fc172220be tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:51.533543 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-43e81d5f-ae8d-426a-94c5-56fc172220be tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:51.534067 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-43e81d5f-ae8d-426a-94c5-56fc172220be tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:51.684330 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-43e81d5f-ae8d-426a-94c5-56fc172220be tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:29:51.692889 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-43e81d5f-ae8d-426a-94c5-56fc172220be tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1759 microversion: 2.1 time: 0.173437 Aug 31 01:29:51.693444 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 423/832] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:29:51 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1759 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:29:52.715856 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-9ef09a51-933e-4e61-ae2a-4197242bddfe tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:52.716538 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-9ef09a51-933e-4e61-ae2a-4197242bddfe tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:52.723419 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9ef09a51-933e-4e61-ae2a-4197242bddfe tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:52.731969 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9ef09a51-933e-4e61-ae2a-4197242bddfe tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:52.731969 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9ef09a51-933e-4e61-ae2a-4197242bddfe tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:52.731969 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9ef09a51-933e-4e61-ae2a-4197242bddfe tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:52.731969 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9ef09a51-933e-4e61-ae2a-4197242bddfe tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:52.732324 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9ef09a51-933e-4e61-ae2a-4197242bddfe tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:52.892922 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-9ef09a51-933e-4e61-ae2a-4197242bddfe tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:29:52.913114 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-9ef09a51-933e-4e61-ae2a-4197242bddfe tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1759 microversion: 2.1 time: 0.194205 Aug 31 01:29:52.913114 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 410/833] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:29:52 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1759 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:29:53.935824 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-830acf7f-e8f5-4902-a69f-670bc5917991 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:53.936439 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-830acf7f-e8f5-4902-a69f-670bc5917991 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:53.943340 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-830acf7f-e8f5-4902-a69f-670bc5917991 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:53.943848 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-830acf7f-e8f5-4902-a69f-670bc5917991 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:53.944285 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-830acf7f-e8f5-4902-a69f-670bc5917991 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:53.945044 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-830acf7f-e8f5-4902-a69f-670bc5917991 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:53.945503 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-830acf7f-e8f5-4902-a69f-670bc5917991 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:53.945958 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-830acf7f-e8f5-4902-a69f-670bc5917991 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:54.096289 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-830acf7f-e8f5-4902-a69f-670bc5917991 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:29:54.105361 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-830acf7f-e8f5-4902-a69f-670bc5917991 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1759 microversion: 2.1 time: 0.173486 Aug 31 01:29:54.109294 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 424/834] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:29:53 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1759 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:29:55.125186 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-d17a0faf-f449-4365-9a70-204c009ce324 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:55.125795 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-d17a0faf-f449-4365-9a70-204c009ce324 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:55.132218 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d17a0faf-f449-4365-9a70-204c009ce324 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:55.137567 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d17a0faf-f449-4365-9a70-204c009ce324 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:55.137567 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d17a0faf-f449-4365-9a70-204c009ce324 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:55.137567 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d17a0faf-f449-4365-9a70-204c009ce324 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:55.137567 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d17a0faf-f449-4365-9a70-204c009ce324 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:55.137950 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d17a0faf-f449-4365-9a70-204c009ce324 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:55.291569 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-d17a0faf-f449-4365-9a70-204c009ce324 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:29:55.300002 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-d17a0faf-f449-4365-9a70-204c009ce324 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1759 microversion: 2.1 time: 0.178674 Aug 31 01:29:55.302363 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 411/835] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:29:55 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1759 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:29:56.323279 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-e421e9f2-4eb8-4db1-b0c8-5a219e6873ec tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:56.324420 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-e421e9f2-4eb8-4db1-b0c8-5a219e6873ec tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:56.331085 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e421e9f2-4eb8-4db1-b0c8-5a219e6873ec tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:56.331822 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e421e9f2-4eb8-4db1-b0c8-5a219e6873ec tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:56.332468 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e421e9f2-4eb8-4db1-b0c8-5a219e6873ec tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:56.333333 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e421e9f2-4eb8-4db1-b0c8-5a219e6873ec tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:56.333952 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e421e9f2-4eb8-4db1-b0c8-5a219e6873ec tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:56.334377 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e421e9f2-4eb8-4db1-b0c8-5a219e6873ec tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:56.506181 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-e421e9f2-4eb8-4db1-b0c8-5a219e6873ec tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:29:56.514370 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-e421e9f2-4eb8-4db1-b0c8-5a219e6873ec tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1759 microversion: 2.1 time: 0.195413 Aug 31 01:29:56.515300 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 425/836] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:29:56 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1759 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:29:57.537367 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-06a02578-0b47-4083-a70b-88fd55ba6619 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:29:57.537965 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-06a02578-0b47-4083-a70b-88fd55ba6619 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:29:57.540385 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:29:57.548489 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-06a02578-0b47-4083-a70b-88fd55ba6619 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:57.548489 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-06a02578-0b47-4083-a70b-88fd55ba6619 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:57.548489 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-06a02578-0b47-4083-a70b-88fd55ba6619 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:57.548489 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-06a02578-0b47-4083-a70b-88fd55ba6619 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:29:57.548887 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-06a02578-0b47-4083-a70b-88fd55ba6619 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:29:57.548887 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-06a02578-0b47-4083-a70b-88fd55ba6619 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:29:57.694522 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-06a02578-0b47-4083-a70b-88fd55ba6619 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:29:57.703511 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-06a02578-0b47-4083-a70b-88fd55ba6619 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1762 microversion: 2.1 time: 0.170322 Aug 31 01:29:57.704092 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 412/837] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:29:57 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1762 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:30:36.392697 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-82e621b8-98aa-4090-b0f4-46a6cc186b13 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2009313173"}} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:30:36.393304 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-82e621b8-98aa-4090-b0f4-46a6cc186b13 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:30:36.395353 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_api:SELECT=13 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:30:36.396014 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell1:SELECT=39 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:30:36.400983 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-82e621b8-98aa-4090-b0f4-46a6cc186b13 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:30:36.401379 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-82e621b8-98aa-4090-b0f4-46a6cc186b13 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:30:36.401818 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-82e621b8-98aa-4090-b0f4-46a6cc186b13 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:30:36.402523 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-82e621b8-98aa-4090-b0f4-46a6cc186b13 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:30:36.402980 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-82e621b8-98aa-4090-b0f4-46a6cc186b13 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:30:36.403409 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-82e621b8-98aa-4090-b0f4-46a6cc186b13 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:30:36.541187 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.network.security_group_api [None req-82e621b8-98aa-4090-b0f4-46a6cc186b13 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Removing security group 330e6ac8-6ca1-473d-bc66-9bf1ae91d293 from port 9a52ea97-a4a8-4c98-835c-b0b492daa956 Aug 31 01:30:36.933128 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-82e621b8-98aa-4090-b0f4-46a6cc186b13 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "POST /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d/action" status: 202 len: 0 microversion: 2.1 time: 0.543570 Aug 31 01:30:36.933128 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 426/838] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 31 01:30:36 2022] POST /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d/action => generated 0 bytes in 545 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 01:30:36.942487 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [req-d9cad2dc-b1bb-40e0-9d88-56fd0390373c req-34be1bcc-d256-4ec0-8d0f-7a0a5584ed4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa12f850-924b-4bc9-8f32-c3f25e4a4d7d", "tag": "9a52ea97-a4a8-4c98-835c-b0b492daa956"}]} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:30:36.955832 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell1:SELECT=47 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:30:36.960218 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-d9cad2dc-b1bb-40e0-9d88-56fd0390373c req-34be1bcc-d256-4ec0-8d0f-7a0a5584ed4a service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:30:36.960964 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-d9cad2dc-b1bb-40e0-9d88-56fd0390373c req-34be1bcc-d256-4ec0-8d0f-7a0a5584ed4a service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:30:36.961793 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-d9cad2dc-b1bb-40e0-9d88-56fd0390373c req-34be1bcc-d256-4ec0-8d0f-7a0a5584ed4a service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:30:36.982431 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.compute.server_external_events [req-d9cad2dc-b1bb-40e0-9d88-56fd0390373c req-34be1bcc-d256-4ec0-8d0f-7a0a5584ed4a service nova] Creating event network-changed:9a52ea97-a4a8-4c98-835c-b0b492daa956 for instance aa12f850-924b-4bc9-8f32-c3f25e4a4d7d on hv-cinder-85528 Aug 31 01:30:36.989977 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [req-d9cad2dc-b1bb-40e0-9d88-56fd0390373c req-34be1bcc-d256-4ec0-8d0f-7a0a5584ed4a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052766 Aug 31 01:30:36.992081 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 413/839] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:30:38.553506 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-28f11701-3492-4aa5-8c00-1e285eb1b575 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:30:38.554418 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-28f11701-3492-4aa5-8c00-1e285eb1b575 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:30:38.560598 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-28f11701-3492-4aa5-8c00-1e285eb1b575 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:30:38.561969 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-28f11701-3492-4aa5-8c00-1e285eb1b575 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:30:38.562947 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-28f11701-3492-4aa5-8c00-1e285eb1b575 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:30:38.563971 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-28f11701-3492-4aa5-8c00-1e285eb1b575 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:30:38.564528 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-28f11701-3492-4aa5-8c00-1e285eb1b575 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:30:38.565230 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-28f11701-3492-4aa5-8c00-1e285eb1b575 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:30:38.766742 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.objects.instance [None req-28f11701-3492-4aa5-8c00-1e285eb1b575 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lazy-loading 'services' on Instance uuid aa12f850-924b-4bc9-8f32-c3f25e4a4d7d {{(pid=121025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:30:39.027542 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [req-cc354414-fc7b-48d5-8b23-3fc8e866448e req-c5b20080-429d-4875-9eb3-52b633125c6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa12f850-924b-4bc9-8f32-c3f25e4a4d7d", "tag": "9a52ea97-a4a8-4c98-835c-b0b492daa956"}]} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:30:39.032549 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-28f11701-3492-4aa5-8c00-1e285eb1b575 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "DELETE /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d/os-volume_attachments/d34645a2-ac86-4b40-b221-a051ae0c3885" status: 202 len: 0 microversion: 2.1 time: 0.480774 Aug 31 01:30:39.033177 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 427/840] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 31 01:30:38 2022] DELETE /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d/os-volume_attachments/d34645a2-ac86-4b40-b221-a051ae0c3885 => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 01:30:39.043925 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-5bf8e0a9-c051-40da-b8ce-b00b37ecfab0 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:30:39.046773 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-5bf8e0a9-c051-40da-b8ce-b00b37ecfab0 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:30:39.048558 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-cc354414-fc7b-48d5-8b23-3fc8e866448e req-c5b20080-429d-4875-9eb3-52b633125c6f service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:30:39.049064 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-cc354414-fc7b-48d5-8b23-3fc8e866448e req-c5b20080-429d-4875-9eb3-52b633125c6f service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:30:39.049680 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-cc354414-fc7b-48d5-8b23-3fc8e866448e req-c5b20080-429d-4875-9eb3-52b633125c6f service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:30:39.054088 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5bf8e0a9-c051-40da-b8ce-b00b37ecfab0 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:30:39.054768 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5bf8e0a9-c051-40da-b8ce-b00b37ecfab0 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:30:39.055201 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5bf8e0a9-c051-40da-b8ce-b00b37ecfab0 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:30:39.061561 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5bf8e0a9-c051-40da-b8ce-b00b37ecfab0 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:30:39.061561 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5bf8e0a9-c051-40da-b8ce-b00b37ecfab0 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:30:39.061561 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5bf8e0a9-c051-40da-b8ce-b00b37ecfab0 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:30:39.062699 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.compute.server_external_events [req-cc354414-fc7b-48d5-8b23-3fc8e866448e req-c5b20080-429d-4875-9eb3-52b633125c6f service nova] Creating event network-changed:9a52ea97-a4a8-4c98-835c-b0b492daa956 for instance aa12f850-924b-4bc9-8f32-c3f25e4a4d7d on hv-cinder-85528 Aug 31 01:30:39.070320 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [req-cc354414-fc7b-48d5-8b23-3fc8e866448e req-c5b20080-429d-4875-9eb3-52b633125c6f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052968 Aug 31 01:30:39.071020 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 414/841] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:30:39.103364 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-5bf8e0a9-c051-40da-b8ce-b00b37ecfab0 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065393 Aug 31 01:30:39.114601 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 428/842] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 01:30:39 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:30:40.119519 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-bc11e1b8-5679-4aec-82f2-12ccbc81e0b9 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:30:40.122089 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-bc11e1b8-5679-4aec-82f2-12ccbc81e0b9 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:30:40.129495 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-bc11e1b8-5679-4aec-82f2-12ccbc81e0b9 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:30:40.135874 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-bc11e1b8-5679-4aec-82f2-12ccbc81e0b9 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:30:40.135874 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-bc11e1b8-5679-4aec-82f2-12ccbc81e0b9 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:30:40.135874 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-bc11e1b8-5679-4aec-82f2-12ccbc81e0b9 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:30:40.135874 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-bc11e1b8-5679-4aec-82f2-12ccbc81e0b9 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:30:40.136222 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-bc11e1b8-5679-4aec-82f2-12ccbc81e0b9 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:30:40.162894 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-bc11e1b8-5679-4aec-82f2-12ccbc81e0b9 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048991 Aug 31 01:30:40.163459 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 415/843] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 31 01:30:40 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 01:30:40.174881 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-df8e4156-028b-48ec-bec4-1449407ff242 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:30:40.175436 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-df8e4156-028b-48ec-bec4-1449407ff242 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:30:40.183565 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-df8e4156-028b-48ec-bec4-1449407ff242 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:30:40.184050 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-df8e4156-028b-48ec-bec4-1449407ff242 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:30:40.190328 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-df8e4156-028b-48ec-bec4-1449407ff242 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:30:40.192687 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-df8e4156-028b-48ec-bec4-1449407ff242 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:30:40.192687 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-df8e4156-028b-48ec-bec4-1449407ff242 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:30:40.192687 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-df8e4156-028b-48ec-bec4-1449407ff242 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:30:40.313653 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.wsgi [None req-df8e4156-028b-48ec-bec4-1449407ff242 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] HTTP exception thrown: Instance aa12f850-924b-4bc9-8f32-c3f25e4a4d7d is not attached to volume d34645a2-ac86-4b40-b221-a051ae0c3885 Aug 31 01:30:40.316085 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-df8e4156-028b-48ec-bec4-1449407ff242 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Request method failure captured: Aug 31 01:30:40.316085 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: request: DELETE /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d/os-volume_attachments/d34645a2-ac86-4b40-b221-a051ae0c3885 HTTP/1.1 Aug 31 01:30:40.316085 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept: application/json Aug 31 01:30:40.316085 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept-Encoding: identity Aug 31 01:30:40.316085 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Connection: close Aug 31 01:30:40.316085 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Length: 0 Aug 31 01:30:40.316085 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Type: application/json Aug 31 01:30:40.316085 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Host: 10.222.0.20 Aug 31 01:30:40.316085 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Openstack-System-Scope: None Aug 31 01:30:40.316085 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: User-Agent: python-urllib3/1.26.12 Aug 31 01:30:40.316085 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Auth-Token: gAAAAABjDrkshKiDYrS3gnl_leQQgJg9SqvF6pxY2YOTGPC3oeq6tE_04ovReRHGR7nF2ZHjRRdZ8yBGXeAFzVWqClrudUwFo-E4LnvzHYGbWRPTkvcO2Jsz7IzG85eXxoRSsQ73jKpw6Bf2WEYWMPqhyMmpxCibYd-91ZCB-EBGnxDYu-I8kEo Aug 31 01:30:40.316085 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Id: None Aug 31 01:30:40.316085 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Name: None Aug 31 01:30:40.316085 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Identity-Status: Confirmed Aug 31 01:30:40.316085 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Is-Admin-Project: True Aug 31 01:30:40.316085 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Id: default Aug 31 01:30:40.316085 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Name: Default Aug 31 01:30:40.316085 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Id: 9befc65a9da84a99942b803ac6a15a0b Aug 31 01:30:40.316085 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Name: tempest-TestMinimumBasicScenario-1747351547 Aug 31 01:30:40.316085 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Role: member,reader Aug 31 01:30:40.316085 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Roles: member,reader Aug 31 01:30:40.317847 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9befc65a9da84a99942b803ac6a15a0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9befc65a9da84a99942b803ac6a15a0b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9befc65a9da84a99942b803ac6a15a0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9befc65a9da84a99942b803ac6a15a0b"}]}] Aug 31 01:30:40.317847 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant: tempest-TestMinimumBasicScenario-1747351547 Aug 31 01:30:40.317847 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Id: 9befc65a9da84a99942b803ac6a15a0b Aug 31 01:30:40.317847 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1747351547 Aug 31 01:30:40.317847 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User: tempest-TestMinimumBasicScenario-1747351547-project Aug 31 01:30:40.317847 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Id: default Aug 31 01:30:40.317847 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Name: Default Aug 31 01:30:40.317847 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Id: cb0154f4a3704bd0b746071bdfb90420 Aug 31 01:30:40.317847 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Name: tempest-TestMinimumBasicScenario-1747351547-project Aug 31 01:30:40.317847 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: method: > Aug 31 01:30:40.317847 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: exception: Instance aa12f850-924b-4bc9-8f32-c3f25e4a4d7d is not attached to volume d34645a2-ac86-4b40-b221-a051ae0c3885 Aug 31 01:30:40.318757 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: action_args: {'server_id': 'aa12f850-924b-4bc9-8f32-c3f25e4a4d7d', 'id': 'd34645a2-ac86-4b40-b221-a051ae0c3885'} Aug 31 01:30:40.318757 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:30:40.318757 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:30:40.318757 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 31 01:30:40.318757 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 31 01:30:40.318757 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 01:30:40.318757 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 01:30:40.318757 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 31 01:30:40.318757 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 31 01:30:40.318757 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d34645a2-ac86-4b40-b221-a051ae0c3885. Aug 31 01:30:40.318757 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:30:40.318757 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:30:40.318757 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:30:40.318757 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:30:40.318757 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:30:40.318757 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:30:40.318757 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:30:40.318757 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:30:40.318757 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:30:40.320069 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:30:40.320069 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 31 01:30:40.320069 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 01:30:40.320069 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa12f850-924b-4bc9-8f32-c3f25e4a4d7d is not attached to volume d34645a2-ac86-4b40-b221-a051ae0c3885 Aug 31 01:30:40.320069 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:30:40.320069 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:30:40.320069 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:30:40.320069 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:30:40.320069 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:30:40.320069 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:30:40.320069 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:30:40.320069 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:30:40.320069 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa12f850-924b-4bc9-8f32-c3f25e4a4d7d is not attached to volume d34645a2-ac86-4b40-b221-a051ae0c3885 Aug 31 01:30:40.320069 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:30:40.322695 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-df8e4156-028b-48ec-bec4-1449407ff242 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Returning 404 to user: Instance aa12f850-924b-4bc9-8f32-c3f25e4a4d7d is not attached to volume d34645a2-ac86-4b40-b221-a051ae0c3885 {{(pid=121025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:30:40.323758 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-df8e4156-028b-48ec-bec4-1449407ff242 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "DELETE /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d/os-volume_attachments/d34645a2-ac86-4b40-b221-a051ae0c3885" status: 404 len: 154 microversion: 2.1 time: 0.153640 Aug 31 01:30:40.324753 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 429/844] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 31 01:30:40 2022] DELETE /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d/os-volume_attachments/d34645a2-ac86-4b40-b221-a051ae0c3885 => generated 154 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:30:41.643975 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-177d9179-e01c-40db-b351-0845e07a3984 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:30:41.645077 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-177d9179-e01c-40db-b351-0845e07a3984 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:30:41.657274 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-177d9179-e01c-40db-b351-0845e07a3984 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:30:41.657895 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-177d9179-e01c-40db-b351-0845e07a3984 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:30:41.658339 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-177d9179-e01c-40db-b351-0845e07a3984 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:30:41.659107 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-177d9179-e01c-40db-b351-0845e07a3984 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:30:41.659593 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-177d9179-e01c-40db-b351-0845e07a3984 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:30:41.660023 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-177d9179-e01c-40db-b351-0845e07a3984 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:30:41.691028 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-177d9179-e01c-40db-b351-0845e07a3984 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Going to try to terminate instance {{(pid=121026) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 01:30:42.021972 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-177d9179-e01c-40db-b351-0845e07a3984 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "DELETE /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 204 len: 0 microversion: 2.1 time: 0.383818 Aug 31 01:30:42.022756 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 416/845] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 01:30:41 2022] DELETE /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 01:30:42.031779 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-b92c690a-9bec-474b-ac4e-d3ad216f7b44 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:30:42.032391 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-b92c690a-9bec-474b-ac4e-d3ad216f7b44 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:30:42.038916 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b92c690a-9bec-474b-ac4e-d3ad216f7b44 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:30:42.039401 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b92c690a-9bec-474b-ac4e-d3ad216f7b44 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:30:42.041028 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b92c690a-9bec-474b-ac4e-d3ad216f7b44 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:30:42.041788 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b92c690a-9bec-474b-ac4e-d3ad216f7b44 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:30:42.042264 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b92c690a-9bec-474b-ac4e-d3ad216f7b44 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:30:42.042692 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b92c690a-9bec-474b-ac4e-d3ad216f7b44 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:30:42.204369 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-b92c690a-9bec-474b-ac4e-d3ad216f7b44 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:30:42.214217 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-b92c690a-9bec-474b-ac4e-d3ad216f7b44 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1556 microversion: 2.1 time: 0.186885 Aug 31 01:30:42.214785 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 430/846] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:30:42 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1556 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:30:43.237797 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-e4030414-dc0a-4a1f-9101-1c9efe3d9b8b tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:30:43.239737 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-e4030414-dc0a-4a1f-9101-1c9efe3d9b8b tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:30:43.245129 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e4030414-dc0a-4a1f-9101-1c9efe3d9b8b tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:30:43.245672 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e4030414-dc0a-4a1f-9101-1c9efe3d9b8b tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:30:43.246041 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e4030414-dc0a-4a1f-9101-1c9efe3d9b8b tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:30:43.246739 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e4030414-dc0a-4a1f-9101-1c9efe3d9b8b tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:30:43.247343 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e4030414-dc0a-4a1f-9101-1c9efe3d9b8b tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:30:43.247928 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e4030414-dc0a-4a1f-9101-1c9efe3d9b8b tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:30:43.422323 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-e4030414-dc0a-4a1f-9101-1c9efe3d9b8b tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:30:43.437318 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-e4030414-dc0a-4a1f-9101-1c9efe3d9b8b tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1556 microversion: 2.1 time: 0.204966 Aug 31 01:30:43.438095 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 417/847] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:30:43 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1556 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:30:44.343738 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-efee4004-c5bb-4b97-b26e-db5215d9f3b5 req-787857bb-77b9-43cb-bf27-b8565870344f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa12f850-924b-4bc9-8f32-c3f25e4a4d7d", "name": "network-vif-deleted", "tag": "9a52ea97-a4a8-4c98-835c-b0b492daa956"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:30:44.359111 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-efee4004-c5bb-4b97-b26e-db5215d9f3b5 req-787857bb-77b9-43cb-bf27-b8565870344f service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:30:44.359881 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-efee4004-c5bb-4b97-b26e-db5215d9f3b5 req-787857bb-77b9-43cb-bf27-b8565870344f service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:30:44.373677 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-efee4004-c5bb-4b97-b26e-db5215d9f3b5 req-787857bb-77b9-43cb-bf27-b8565870344f service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:30:44.373677 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-efee4004-c5bb-4b97-b26e-db5215d9f3b5 req-787857bb-77b9-43cb-bf27-b8565870344f service nova] Creating event network-vif-deleted:9a52ea97-a4a8-4c98-835c-b0b492daa956 for instance aa12f850-924b-4bc9-8f32-c3f25e4a4d7d on hv-cinder-85528 Aug 31 01:30:44.378670 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-efee4004-c5bb-4b97-b26e-db5215d9f3b5 req-787857bb-77b9-43cb-bf27-b8565870344f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039119 Aug 31 01:30:44.379607 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 431/848] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:30:44.462580 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-97669d5e-c618-46ad-8455-72051d1d76df tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:30:44.463193 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-97669d5e-c618-46ad-8455-72051d1d76df tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:30:44.474029 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-97669d5e-c618-46ad-8455-72051d1d76df tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:30:44.474705 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-97669d5e-c618-46ad-8455-72051d1d76df tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:30:44.475150 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-97669d5e-c618-46ad-8455-72051d1d76df tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:30:44.475861 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-97669d5e-c618-46ad-8455-72051d1d76df tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:30:44.476620 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-97669d5e-c618-46ad-8455-72051d1d76df tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:30:44.477068 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-97669d5e-c618-46ad-8455-72051d1d76df tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:30:44.570867 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-97669d5e-c618-46ad-8455-72051d1d76df tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:30:44.582306 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-97669d5e-c618-46ad-8455-72051d1d76df tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1514 microversion: 2.1 time: 0.127295 Aug 31 01:30:44.585725 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 418/849] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:30:44 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1514 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:30:45.613691 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-832e719a-8142-4db5-8147-0b4e0d7654f0 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:30:45.614475 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-832e719a-8142-4db5-8147-0b4e0d7654f0 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:30:45.622415 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-832e719a-8142-4db5-8147-0b4e0d7654f0 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:30:45.623725 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-832e719a-8142-4db5-8147-0b4e0d7654f0 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:30:45.624751 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-832e719a-8142-4db5-8147-0b4e0d7654f0 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:30:45.625634 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-832e719a-8142-4db5-8147-0b4e0d7654f0 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:30:45.626260 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-832e719a-8142-4db5-8147-0b4e0d7654f0 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:30:45.629414 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-832e719a-8142-4db5-8147-0b4e0d7654f0 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:30:45.663249 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-832e719a-8142-4db5-8147-0b4e0d7654f0 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:30:45.663739 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-832e719a-8142-4db5-8147-0b4e0d7654f0 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:30:45.664176 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-832e719a-8142-4db5-8147-0b4e0d7654f0 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:30:45.664632 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.objects.instance [None req-832e719a-8142-4db5-8147-0b4e0d7654f0 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lazy-loading 'fault' on Instance uuid aa12f850-924b-4bc9-8f32-c3f25e4a4d7d {{(pid=121025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:30:45.753857 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-832e719a-8142-4db5-8147-0b4e0d7654f0 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0154f4a3704bd0b746071bdfb90420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9befc65a9da84a99942b803ac6a15a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:30:45.755579 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-832e719a-8142-4db5-8147-0b4e0d7654f0 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 200 len: 1349 microversion: 2.1 time: 0.147031 Aug 31 01:30:45.780220 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 432/850] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:30:45 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 1349 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:30:46.787486 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-71499d0d-759b-454f-b607-438f0213c773 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:30:46.798422 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-71499d0d-759b-454f-b607-438f0213c773 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] [instance: aa12f850-924b-4bc9-8f32-c3f25e4a4d7d] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:30:46.798422 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-71499d0d-759b-454f-b607-438f0213c773 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:30:46.798422 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-71499d0d-759b-454f-b607-438f0213c773 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:30:46.798422 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-71499d0d-759b-454f-b607-438f0213c773 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:30:46.799059 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-71499d0d-759b-454f-b607-438f0213c773 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:30:46.799059 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-71499d0d-759b-454f-b607-438f0213c773 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:30:46.799059 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-71499d0d-759b-454f-b607-438f0213c773 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:30:46.817958 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.wsgi [None req-71499d0d-759b-454f-b607-438f0213c773 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] HTTP exception thrown: Instance aa12f850-924b-4bc9-8f32-c3f25e4a4d7d could not be found. Aug 31 01:30:46.819839 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-71499d0d-759b-454f-b607-438f0213c773 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Request method failure captured: Aug 31 01:30:46.819839 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: request: GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d HTTP/1.1 Aug 31 01:30:46.819839 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept: application/json Aug 31 01:30:46.819839 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept-Encoding: identity Aug 31 01:30:46.819839 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Connection: close Aug 31 01:30:46.819839 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Length: 0 Aug 31 01:30:46.819839 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Type: application/json Aug 31 01:30:46.819839 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Host: 10.222.0.20 Aug 31 01:30:46.819839 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Openstack-System-Scope: None Aug 31 01:30:46.819839 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: User-Agent: python-urllib3/1.26.12 Aug 31 01:30:46.819839 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Auth-Token: gAAAAABjDrkshKiDYrS3gnl_leQQgJg9SqvF6pxY2YOTGPC3oeq6tE_04ovReRHGR7nF2ZHjRRdZ8yBGXeAFzVWqClrudUwFo-E4LnvzHYGbWRPTkvcO2Jsz7IzG85eXxoRSsQ73jKpw6Bf2WEYWMPqhyMmpxCibYd-91ZCB-EBGnxDYu-I8kEo Aug 31 01:30:46.819839 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Id: None Aug 31 01:30:46.819839 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Name: None Aug 31 01:30:46.819839 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Identity-Status: Confirmed Aug 31 01:30:46.819839 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Is-Admin-Project: True Aug 31 01:30:46.819839 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Id: default Aug 31 01:30:46.819839 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Name: Default Aug 31 01:30:46.819839 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Id: 9befc65a9da84a99942b803ac6a15a0b Aug 31 01:30:46.819839 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Name: tempest-TestMinimumBasicScenario-1747351547 Aug 31 01:30:46.819839 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Role: member,reader Aug 31 01:30:46.819839 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Roles: member,reader Aug 31 01:30:46.829985 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9befc65a9da84a99942b803ac6a15a0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9befc65a9da84a99942b803ac6a15a0b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9befc65a9da84a99942b803ac6a15a0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9befc65a9da84a99942b803ac6a15a0b"}]}] Aug 31 01:30:46.829985 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant: tempest-TestMinimumBasicScenario-1747351547 Aug 31 01:30:46.829985 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Id: 9befc65a9da84a99942b803ac6a15a0b Aug 31 01:30:46.829985 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1747351547 Aug 31 01:30:46.829985 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User: tempest-TestMinimumBasicScenario-1747351547-project Aug 31 01:30:46.829985 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Id: default Aug 31 01:30:46.829985 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Name: Default Aug 31 01:30:46.829985 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Id: cb0154f4a3704bd0b746071bdfb90420 Aug 31 01:30:46.829985 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Name: tempest-TestMinimumBasicScenario-1747351547-project Aug 31 01:30:46.829985 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: method: > Aug 31 01:30:46.829985 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: exception: Instance aa12f850-924b-4bc9-8f32-c3f25e4a4d7d could not be found. Aug 31 01:30:46.829985 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: action_args: {'id': 'aa12f850-924b-4bc9-8f32-c3f25e4a4d7d'} Aug 31 01:30:46.831269 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:30:46.831269 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:30:46.831269 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:30:46.831269 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:30:46.831269 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:30:46.831269 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:30:46.831269 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:30:46.831269 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:30:46.831269 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:30:46.831269 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:30:46.831269 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa12f850-924b-4bc9-8f32-c3f25e4a4d7d could not be found. Aug 31 01:30:46.831269 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:30:46.831269 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:30:46.831269 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:30:46.831269 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:30:46.831269 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:30:46.831269 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:30:46.831269 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:30:46.831269 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:30:46.831269 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:30:46.832710 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:30:46.832710 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:30:46.832710 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:30:46.832710 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:30:46.832710 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:30:46.832710 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:30:46.832710 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:30:46.832710 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa12f850-924b-4bc9-8f32-c3f25e4a4d7d could not be found. Aug 31 01:30:46.832710 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:30:46.832710 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:30:46.832710 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:30:46.832710 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:30:46.832710 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:30:46.832710 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:30:46.832710 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:30:46.832710 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:30:46.832710 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa12f850-924b-4bc9-8f32-c3f25e4a4d7d could not be found. Aug 31 01:30:46.832710 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:30:46.834130 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-71499d0d-759b-454f-b607-438f0213c773 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Returning 404 to user: Instance aa12f850-924b-4bc9-8f32-c3f25e4a4d7d could not be found. {{(pid=121026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:30:46.834130 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-71499d0d-759b-454f-b607-438f0213c773 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d" status: 404 len: 111 microversion: 2.1 time: 0.037718 Aug 31 01:30:46.834130 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 419/851] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:30:46 2022] GET /compute/v2.1/servers/aa12f850-924b-4bc9-8f32-c3f25e4a4d7d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 01:30:46.837006 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-a0a62ce1-f0f2-4384-b59e-4faec08d5430 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] Calling method '.version_select at 0x7f1fe14d5b80>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:30:46.971607 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-a0a62ce1-f0f2-4384-b59e-4faec08d5430 tempest-TestMinimumBasicScenario-1747351547 tempest-TestMinimumBasicScenario-1747351547-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1780112385" status: 202 len: 0 microversion: 2.1 time: 0.135792 Aug 31 01:30:46.972557 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 433/852] 10.222.0.20 () {58 vars in 1272 bytes} [Wed Aug 31 01:30:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1780112385 => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 01:30:54.273996 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-34143644-c7ba-4286-af06-e1eab486efd7 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-594385707", "imageRef": "ed6d3236-defa-4ccf-90ba-343c0d0ad58e", "flavorRef": "452", "networks": [{"uuid": "6c8eb03f-5a07-4b24-883d-dad667ce7877"}]}} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:30:54.368606 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.network.neutron [None req-34143644-c7ba-4286-af06-e1eab486efd7 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] validate_networks() for [('6c8eb03f-5a07-4b24-883d-dad667ce7877', None, None, None, None, None)] {{(pid=121026) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 01:30:55.020442 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.virt.hardware [None req-34143644-c7ba-4286-af06-e1eab486efd7 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Flavor limits 0:0:0 {{(pid=121026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 01:30:55.022537 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.virt.hardware [None req-34143644-c7ba-4286-af06-e1eab486efd7 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Image limits 0:0:0 {{(pid=121026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 01:30:55.023213 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.virt.hardware [None req-34143644-c7ba-4286-af06-e1eab486efd7 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Flavor pref 0:0:0 {{(pid=121026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 01:30:55.023802 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.virt.hardware [None req-34143644-c7ba-4286-af06-e1eab486efd7 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Image pref 0:0:0 {{(pid=121026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 01:30:55.025070 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.virt.hardware [None req-34143644-c7ba-4286-af06-e1eab486efd7 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 01:30:55.048548 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-34143644-c7ba-4286-af06-e1eab486efd7 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:30:55.049356 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-34143644-c7ba-4286-af06-e1eab486efd7 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:30:55.049863 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-34143644-c7ba-4286-af06-e1eab486efd7 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:30:55.050936 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-34143644-c7ba-4286-af06-e1eab486efd7 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:30:55.051537 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-34143644-c7ba-4286-af06-e1eab486efd7 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:30:55.052029 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-34143644-c7ba-4286-af06-e1eab486efd7 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:30:55.071266 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.quota [None req-34143644-c7ba-4286-af06-e1eab486efd7 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Getting quotas for project f9084d8c977147b7a3652e34466b2522. Resources: {'instances', 'cores', 'ram'} {{(pid=121026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 01:30:55.075913 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.quota [None req-34143644-c7ba-4286-af06-e1eab486efd7 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Getting quotas for user 78b0a7bb7fed432cadfdd79c2ddab8c4 and project f9084d8c977147b7a3652e34466b2522. Resources: {'instances', 'cores', 'ram'} {{(pid=121026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 01:30:55.102405 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-34143644-c7ba-4286-af06-e1eab486efd7 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Going to run 1 instances... {{(pid=121026) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 01:30:55.106802 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-34143644-c7ba-4286-af06-e1eab486efd7 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] [instance: 1e3545f6-dc34-4bd6-b914-bcead2f56438] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ed6d3236-defa-4ccf-90ba-343c0d0ad58e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121026) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 01:30:55.258917 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-34143644-c7ba-4286-af06-e1eab486efd7 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.988767 Aug 31 01:30:55.260226 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 420/853] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 31 01:30:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 991 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 01:30:55.271230 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-aed51236-44c5-47e9-907f-6819086bd62a tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:30:55.271825 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-aed51236-44c5-47e9-907f-6819086bd62a tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] [instance: 1e3545f6-dc34-4bd6-b914-bcead2f56438] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:30:55.372300 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-aed51236-44c5-47e9-907f-6819086bd62a tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0a7bb7fed432cadfdd79c2ddab8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9084d8c977147b7a3652e34466b2522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:30:55.405334 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-aed51236-44c5-47e9-907f-6819086bd62a tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] 10.222.0.20 "GET /compute/v2.1/servers/1e3545f6-dc34-4bd6-b914-bcead2f56438" status: 200 len: 1213 microversion: 2.1 time: 0.137863 Aug 31 01:30:55.407397 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 434/854] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:30:55 2022] GET /compute/v2.1/servers/1e3545f6-dc34-4bd6-b914-bcead2f56438 => generated 1213 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:30:56.426857 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-ce97c4a5-8884-41cb-a3e3-758b600ff334 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:30:56.428107 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-ce97c4a5-8884-41cb-a3e3-758b600ff334 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] [instance: 1e3545f6-dc34-4bd6-b914-bcead2f56438] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:30:56.435153 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ce97c4a5-8884-41cb-a3e3-758b600ff334 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:30:56.435682 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ce97c4a5-8884-41cb-a3e3-758b600ff334 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:30:56.436521 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ce97c4a5-8884-41cb-a3e3-758b600ff334 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:30:56.437263 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ce97c4a5-8884-41cb-a3e3-758b600ff334 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:30:56.438239 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ce97c4a5-8884-41cb-a3e3-758b600ff334 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:30:56.438239 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ce97c4a5-8884-41cb-a3e3-758b600ff334 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:30:56.542735 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-ce97c4a5-8884-41cb-a3e3-758b600ff334 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0a7bb7fed432cadfdd79c2ddab8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9084d8c977147b7a3652e34466b2522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:30:56.556547 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-ce97c4a5-8884-41cb-a3e3-758b600ff334 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] 10.222.0.20 "GET /compute/v2.1/servers/1e3545f6-dc34-4bd6-b914-bcead2f56438" status: 200 len: 1217 microversion: 2.1 time: 0.129360 Aug 31 01:30:56.556547 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 421/855] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:30:56 2022] GET /compute/v2.1/servers/1e3545f6-dc34-4bd6-b914-bcead2f56438 => generated 1217 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:30:57.186735 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-5ecdf12b-0d63-4d99-87f0-0dfd59ee36fe tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1735061050", "imageRef": "ed6d3236-defa-4ccf-90ba-343c0d0ad58e", "flavorRef": "452", "networks": [{"uuid": "5ae771f9-b42a-4b35-89fa-0e126c4452ca"}]}} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:30:57.203016 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:30:57.261251 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.network.neutron [None req-5ecdf12b-0d63-4d99-87f0-0dfd59ee36fe tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] validate_networks() for [('5ae771f9-b42a-4b35-89fa-0e126c4452ca', None, None, None, None, None)] {{(pid=121025) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 01:30:57.572800 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-af712509-1219-4250-9467-96fef543ec60 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:30:57.573513 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-af712509-1219-4250-9467-96fef543ec60 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] [instance: 1e3545f6-dc34-4bd6-b914-bcead2f56438] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:30:57.588977 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-af712509-1219-4250-9467-96fef543ec60 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:30:57.589475 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-af712509-1219-4250-9467-96fef543ec60 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:30:57.589913 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-af712509-1219-4250-9467-96fef543ec60 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:30:57.590747 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-af712509-1219-4250-9467-96fef543ec60 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:30:57.591212 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-af712509-1219-4250-9467-96fef543ec60 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:30:57.591830 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-af712509-1219-4250-9467-96fef543ec60 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:30:57.734822 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-af712509-1219-4250-9467-96fef543ec60 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0a7bb7fed432cadfdd79c2ddab8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9084d8c977147b7a3652e34466b2522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:30:57.744113 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-af712509-1219-4250-9467-96fef543ec60 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] 10.222.0.20 "GET /compute/v2.1/servers/1e3545f6-dc34-4bd6-b914-bcead2f56438" status: 200 len: 1265 microversion: 2.1 time: 0.175748 Aug 31 01:30:57.744959 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 422/856] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:30:57 2022] GET /compute/v2.1/servers/1e3545f6-dc34-4bd6-b914-bcead2f56438 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:30:58.013018 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-5ecdf12b-0d63-4d99-87f0-0dfd59ee36fe tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Flavor limits 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 01:30:58.014054 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-5ecdf12b-0d63-4d99-87f0-0dfd59ee36fe tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Image limits 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 01:30:58.014535 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-5ecdf12b-0d63-4d99-87f0-0dfd59ee36fe tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Flavor pref 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 01:30:58.014941 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-5ecdf12b-0d63-4d99-87f0-0dfd59ee36fe tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Image pref 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 01:30:58.015351 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-5ecdf12b-0d63-4d99-87f0-0dfd59ee36fe tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 01:30:58.024455 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5ecdf12b-0d63-4d99-87f0-0dfd59ee36fe tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:30:58.025109 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5ecdf12b-0d63-4d99-87f0-0dfd59ee36fe tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:30:58.025603 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5ecdf12b-0d63-4d99-87f0-0dfd59ee36fe tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:30:58.026335 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5ecdf12b-0d63-4d99-87f0-0dfd59ee36fe tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:30:58.026851 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5ecdf12b-0d63-4d99-87f0-0dfd59ee36fe tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:30:58.027372 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5ecdf12b-0d63-4d99-87f0-0dfd59ee36fe tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:30:58.043671 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.quota [None req-5ecdf12b-0d63-4d99-87f0-0dfd59ee36fe tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Getting quotas for project 29c95fae9a51415b9245125f5faedb37. Resources: {'instances', 'cores', 'ram'} {{(pid=121025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 01:30:58.049348 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.quota [None req-5ecdf12b-0d63-4d99-87f0-0dfd59ee36fe tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Getting quotas for user f3e944928454456cabf55a6871dd9cf3 and project 29c95fae9a51415b9245125f5faedb37. Resources: {'instances', 'cores', 'ram'} {{(pid=121025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 01:30:58.060747 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-5ecdf12b-0d63-4d99-87f0-0dfd59ee36fe tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Going to run 1 instances... {{(pid=121025) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 01:30:58.063825 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-5ecdf12b-0d63-4d99-87f0-0dfd59ee36fe tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] [instance: 7993aed7-8d74-4bd0-be09-ca60b8ad8bf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ed6d3236-defa-4ccf-90ba-343c0d0ad58e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 01:30:58.196259 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-5ecdf12b-0d63-4d99-87f0-0dfd59ee36fe tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.018292 Aug 31 01:30:58.198086 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 435/857] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 31 01:30:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1021 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 01:30:58.209380 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-a3b4f3f6-eda4-4799-89ad-584b2e6e2121 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:30:58.210223 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-a3b4f3f6-eda4-4799-89ad-584b2e6e2121 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] [instance: 7993aed7-8d74-4bd0-be09-ca60b8ad8bf1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:30:58.264688 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-a3b4f3f6-eda4-4799-89ad-584b2e6e2121 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e944928454456cabf55a6871dd9cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c95fae9a51415b9245125f5faedb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:30:58.271760 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-a3b4f3f6-eda4-4799-89ad-584b2e6e2121 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] 10.222.0.20 "GET /compute/v2.1/servers/7993aed7-8d74-4bd0-be09-ca60b8ad8bf1" status: 200 len: 1219 microversion: 2.1 time: 0.067164 Aug 31 01:30:58.272325 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 423/858] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:30:58 2022] GET /compute/v2.1/servers/7993aed7-8d74-4bd0-be09-ca60b8ad8bf1 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:30:58.771001 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-1a475e46-7983-43cb-8c4e-a6db3056d405 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:30:58.771883 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-1a475e46-7983-43cb-8c4e-a6db3056d405 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] [instance: 1e3545f6-dc34-4bd6-b914-bcead2f56438] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:30:58.779894 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1a475e46-7983-43cb-8c4e-a6db3056d405 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:30:58.780661 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1a475e46-7983-43cb-8c4e-a6db3056d405 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:30:58.781342 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1a475e46-7983-43cb-8c4e-a6db3056d405 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:30:58.782293 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1a475e46-7983-43cb-8c4e-a6db3056d405 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:30:58.782970 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1a475e46-7983-43cb-8c4e-a6db3056d405 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:30:58.783663 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1a475e46-7983-43cb-8c4e-a6db3056d405 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:30:58.931112 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-1a475e46-7983-43cb-8c4e-a6db3056d405 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0a7bb7fed432cadfdd79c2ddab8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9084d8c977147b7a3652e34466b2522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:30:58.938977 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-1a475e46-7983-43cb-8c4e-a6db3056d405 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] 10.222.0.20 "GET /compute/v2.1/servers/1e3545f6-dc34-4bd6-b914-bcead2f56438" status: 200 len: 1313 microversion: 2.1 time: 0.172650 Aug 31 01:30:58.939579 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 436/859] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:30:58 2022] GET /compute/v2.1/servers/1e3545f6-dc34-4bd6-b914-bcead2f56438 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:30:59.292682 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-52e078c4-46a5-4476-a06f-7966b3c21c22 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:30:59.294290 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-52e078c4-46a5-4476-a06f-7966b3c21c22 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] [instance: 7993aed7-8d74-4bd0-be09-ca60b8ad8bf1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:30:59.348861 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-52e078c4-46a5-4476-a06f-7966b3c21c22 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e944928454456cabf55a6871dd9cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c95fae9a51415b9245125f5faedb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:30:59.355925 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-52e078c4-46a5-4476-a06f-7966b3c21c22 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] 10.222.0.20 "GET /compute/v2.1/servers/7993aed7-8d74-4bd0-be09-ca60b8ad8bf1" status: 200 len: 1219 microversion: 2.1 time: 0.068350 Aug 31 01:30:59.356482 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 424/860] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:30:59 2022] GET /compute/v2.1/servers/7993aed7-8d74-4bd0-be09-ca60b8ad8bf1 => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:30:59.384557 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-46e8fa3e-f081-4adf-a1cf-041734847905 req-79428ce4-9396-4a04-8823-323b14fffea5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e3545f6-dc34-4bd6-b914-bcead2f56438", "tag": "a93fc41f-e643-414b-b069-269e6764c25b"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:30:59.395549 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-46e8fa3e-f081-4adf-a1cf-041734847905 req-79428ce4-9396-4a04-8823-323b14fffea5 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:30:59.396166 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-46e8fa3e-f081-4adf-a1cf-041734847905 req-79428ce4-9396-4a04-8823-323b14fffea5 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:30:59.396893 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-46e8fa3e-f081-4adf-a1cf-041734847905 req-79428ce4-9396-4a04-8823-323b14fffea5 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:30:59.409318 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-46e8fa3e-f081-4adf-a1cf-041734847905 req-79428ce4-9396-4a04-8823-323b14fffea5 service nova] Creating event network-changed:a93fc41f-e643-414b-b069-269e6764c25b for instance 1e3545f6-dc34-4bd6-b914-bcead2f56438 on hv-cinder-85528 Aug 31 01:30:59.414531 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-46e8fa3e-f081-4adf-a1cf-041734847905 req-79428ce4-9396-4a04-8823-323b14fffea5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035484 Aug 31 01:30:59.415211 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 437/861] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:30:59.961969 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-a73e32c3-3653-4176-b2d0-9d83cfcffeeb tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:30:59.962981 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-a73e32c3-3653-4176-b2d0-9d83cfcffeeb tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] [instance: 1e3545f6-dc34-4bd6-b914-bcead2f56438] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:30:59.970271 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a73e32c3-3653-4176-b2d0-9d83cfcffeeb tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:30:59.971273 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a73e32c3-3653-4176-b2d0-9d83cfcffeeb tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:30:59.971956 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a73e32c3-3653-4176-b2d0-9d83cfcffeeb tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:30:59.972979 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a73e32c3-3653-4176-b2d0-9d83cfcffeeb tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:30:59.973791 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a73e32c3-3653-4176-b2d0-9d83cfcffeeb tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:30:59.974634 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a73e32c3-3653-4176-b2d0-9d83cfcffeeb tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:00.118584 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-a73e32c3-3653-4176-b2d0-9d83cfcffeeb tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0a7bb7fed432cadfdd79c2ddab8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9084d8c977147b7a3652e34466b2522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:31:00.128599 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-a73e32c3-3653-4176-b2d0-9d83cfcffeeb tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] 10.222.0.20 "GET /compute/v2.1/servers/1e3545f6-dc34-4bd6-b914-bcead2f56438" status: 200 len: 1313 microversion: 2.1 time: 0.170672 Aug 31 01:31:00.129725 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 425/862] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:30:59 2022] GET /compute/v2.1/servers/1e3545f6-dc34-4bd6-b914-bcead2f56438 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:31:00.376635 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-d12b927c-516d-4de5-93ce-4a7ba6c91729 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:31:00.377423 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-d12b927c-516d-4de5-93ce-4a7ba6c91729 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] [instance: 7993aed7-8d74-4bd0-be09-ca60b8ad8bf1] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:31:00.433656 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-d12b927c-516d-4de5-93ce-4a7ba6c91729 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e944928454456cabf55a6871dd9cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c95fae9a51415b9245125f5faedb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:31:00.441400 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-d12b927c-516d-4de5-93ce-4a7ba6c91729 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] 10.222.0.20 "GET /compute/v2.1/servers/7993aed7-8d74-4bd0-be09-ca60b8ad8bf1" status: 200 len: 1219 microversion: 2.1 time: 0.069838 Aug 31 01:31:00.442004 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 438/863] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:31:00 2022] GET /compute/v2.1/servers/7993aed7-8d74-4bd0-be09-ca60b8ad8bf1 => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:31:01.150783 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-d976c0d4-13fa-4a4e-a3bc-d6c0129738db tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:31:01.151425 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-d976c0d4-13fa-4a4e-a3bc-d6c0129738db tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] [instance: 1e3545f6-dc34-4bd6-b914-bcead2f56438] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:31:01.158852 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d976c0d4-13fa-4a4e-a3bc-d6c0129738db tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:01.159345 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d976c0d4-13fa-4a4e-a3bc-d6c0129738db tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:01.159784 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d976c0d4-13fa-4a4e-a3bc-d6c0129738db tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:01.160522 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d976c0d4-13fa-4a4e-a3bc-d6c0129738db tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:01.161014 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d976c0d4-13fa-4a4e-a3bc-d6c0129738db tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:01.161442 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d976c0d4-13fa-4a4e-a3bc-d6c0129738db tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:01.290374 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-d976c0d4-13fa-4a4e-a3bc-d6c0129738db tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0a7bb7fed432cadfdd79c2ddab8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9084d8c977147b7a3652e34466b2522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:31:01.299318 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-d976c0d4-13fa-4a4e-a3bc-d6c0129738db tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] 10.222.0.20 "GET /compute/v2.1/servers/1e3545f6-dc34-4bd6-b914-bcead2f56438" status: 200 len: 1313 microversion: 2.1 time: 0.151814 Aug 31 01:31:01.299318 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 426/864] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:31:01 2022] GET /compute/v2.1/servers/1e3545f6-dc34-4bd6-b914-bcead2f56438 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:31:01.462244 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-19429b4d-d777-4083-ade0-01d41b54e0eb tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:31:01.462892 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-19429b4d-d777-4083-ade0-01d41b54e0eb tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] [instance: 7993aed7-8d74-4bd0-be09-ca60b8ad8bf1] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:31:01.518199 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-19429b4d-d777-4083-ade0-01d41b54e0eb tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e944928454456cabf55a6871dd9cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c95fae9a51415b9245125f5faedb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:31:01.525034 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-19429b4d-d777-4083-ade0-01d41b54e0eb tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] 10.222.0.20 "GET /compute/v2.1/servers/7993aed7-8d74-4bd0-be09-ca60b8ad8bf1" status: 200 len: 1219 microversion: 2.1 time: 0.066690 Aug 31 01:31:01.525887 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 439/865] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:31:01 2022] GET /compute/v2.1/servers/7993aed7-8d74-4bd0-be09-ca60b8ad8bf1 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:31:02.319493 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-b7fd8980-b6b4-4d95-8cf2-44e695379e4d tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:31:02.320630 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-b7fd8980-b6b4-4d95-8cf2-44e695379e4d tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] [instance: 1e3545f6-dc34-4bd6-b914-bcead2f56438] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:31:02.327292 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b7fd8980-b6b4-4d95-8cf2-44e695379e4d tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:02.327786 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b7fd8980-b6b4-4d95-8cf2-44e695379e4d tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:02.328257 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b7fd8980-b6b4-4d95-8cf2-44e695379e4d tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:02.328985 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b7fd8980-b6b4-4d95-8cf2-44e695379e4d tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:02.329442 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b7fd8980-b6b4-4d95-8cf2-44e695379e4d tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:02.329896 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b7fd8980-b6b4-4d95-8cf2-44e695379e4d tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:02.459587 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-b7fd8980-b6b4-4d95-8cf2-44e695379e4d tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0a7bb7fed432cadfdd79c2ddab8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9084d8c977147b7a3652e34466b2522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:31:02.467718 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-b7fd8980-b6b4-4d95-8cf2-44e695379e4d tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] 10.222.0.20 "GET /compute/v2.1/servers/1e3545f6-dc34-4bd6-b914-bcead2f56438" status: 200 len: 1313 microversion: 2.1 time: 0.151667 Aug 31 01:31:02.468281 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 427/866] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:31:02 2022] GET /compute/v2.1/servers/1e3545f6-dc34-4bd6-b914-bcead2f56438 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:31:02.546742 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-df9ac250-35e0-45dc-acde-b6a6cd12fa75 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:31:02.547354 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-df9ac250-35e0-45dc-acde-b6a6cd12fa75 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] [instance: 7993aed7-8d74-4bd0-be09-ca60b8ad8bf1] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:31:02.553942 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-df9ac250-35e0-45dc-acde-b6a6cd12fa75 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:02.554427 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-df9ac250-35e0-45dc-acde-b6a6cd12fa75 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:02.554863 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-df9ac250-35e0-45dc-acde-b6a6cd12fa75 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:02.555554 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-df9ac250-35e0-45dc-acde-b6a6cd12fa75 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:02.556015 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-df9ac250-35e0-45dc-acde-b6a6cd12fa75 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:02.556443 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-df9ac250-35e0-45dc-acde-b6a6cd12fa75 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:02.616877 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-df9ac250-35e0-45dc-acde-b6a6cd12fa75 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e944928454456cabf55a6871dd9cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c95fae9a51415b9245125f5faedb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:31:02.624433 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-df9ac250-35e0-45dc-acde-b6a6cd12fa75 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] 10.222.0.20 "GET /compute/v2.1/servers/7993aed7-8d74-4bd0-be09-ca60b8ad8bf1" status: 200 len: 1223 microversion: 2.1 time: 0.082268 Aug 31 01:31:02.625025 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 440/867] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:31:02 2022] GET /compute/v2.1/servers/7993aed7-8d74-4bd0-be09-ca60b8ad8bf1 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:31:03.222384 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [req-bfdb6679-eb26-486e-a718-646a4e205aa0 req-0c5d1af9-40e6-4636-853c-f4a4addfbbb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e3545f6-dc34-4bd6-b914-bcead2f56438", "name": "network-vif-plugged", "status": "completed", "tag": "a93fc41f-e643-414b-b069-269e6764c25b"}]} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:31:03.232350 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-bfdb6679-eb26-486e-a718-646a4e205aa0 req-0c5d1af9-40e6-4636-853c-f4a4addfbbb6 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:03.238444 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-bfdb6679-eb26-486e-a718-646a4e205aa0 req-0c5d1af9-40e6-4636-853c-f4a4addfbbb6 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:03.238444 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-bfdb6679-eb26-486e-a718-646a4e205aa0 req-0c5d1af9-40e6-4636-853c-f4a4addfbbb6 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:03.245314 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.compute.server_external_events [req-bfdb6679-eb26-486e-a718-646a4e205aa0 req-0c5d1af9-40e6-4636-853c-f4a4addfbbb6 service nova] Creating event network-vif-plugged:a93fc41f-e643-414b-b069-269e6764c25b for instance 1e3545f6-dc34-4bd6-b914-bcead2f56438 on hv-cinder-85528 Aug 31 01:31:03.250249 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [req-bfdb6679-eb26-486e-a718-646a4e205aa0 req-0c5d1af9-40e6-4636-853c-f4a4addfbbb6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031797 Aug 31 01:31:03.250838 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 428/868] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:31:03.489216 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-3bd26cbc-ec85-4016-a817-e5ecb88d025b tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:31:03.489794 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-3bd26cbc-ec85-4016-a817-e5ecb88d025b tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] [instance: 1e3545f6-dc34-4bd6-b914-bcead2f56438] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:31:03.495688 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3bd26cbc-ec85-4016-a817-e5ecb88d025b tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:03.496164 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3bd26cbc-ec85-4016-a817-e5ecb88d025b tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:03.496592 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3bd26cbc-ec85-4016-a817-e5ecb88d025b tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:03.497302 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3bd26cbc-ec85-4016-a817-e5ecb88d025b tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:03.497747 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3bd26cbc-ec85-4016-a817-e5ecb88d025b tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:03.498160 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3bd26cbc-ec85-4016-a817-e5ecb88d025b tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:03.631746 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-3bd26cbc-ec85-4016-a817-e5ecb88d025b tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0a7bb7fed432cadfdd79c2ddab8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9084d8c977147b7a3652e34466b2522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:31:03.639550 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-3bd26cbc-ec85-4016-a817-e5ecb88d025b tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] 10.222.0.20 "GET /compute/v2.1/servers/1e3545f6-dc34-4bd6-b914-bcead2f56438" status: 200 len: 1313 microversion: 2.1 time: 0.154539 Aug 31 01:31:03.640410 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 441/869] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:31:03 2022] GET /compute/v2.1/servers/1e3545f6-dc34-4bd6-b914-bcead2f56438 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:31:03.646180 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-c31f8094-c2dd-4653-8ca4-f9a56c3d3d49 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:31:03.646914 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-c31f8094-c2dd-4653-8ca4-f9a56c3d3d49 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] [instance: 7993aed7-8d74-4bd0-be09-ca60b8ad8bf1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:31:03.653152 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c31f8094-c2dd-4653-8ca4-f9a56c3d3d49 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:03.653631 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c31f8094-c2dd-4653-8ca4-f9a56c3d3d49 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:03.654084 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c31f8094-c2dd-4653-8ca4-f9a56c3d3d49 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:03.654754 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c31f8094-c2dd-4653-8ca4-f9a56c3d3d49 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:03.655205 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c31f8094-c2dd-4653-8ca4-f9a56c3d3d49 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:03.655628 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c31f8094-c2dd-4653-8ca4-f9a56c3d3d49 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:03.719498 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-c31f8094-c2dd-4653-8ca4-f9a56c3d3d49 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e944928454456cabf55a6871dd9cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c95fae9a51415b9245125f5faedb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:31:03.727243 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-c31f8094-c2dd-4653-8ca4-f9a56c3d3d49 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] 10.222.0.20 "GET /compute/v2.1/servers/7993aed7-8d74-4bd0-be09-ca60b8ad8bf1" status: 200 len: 1215 microversion: 2.1 time: 0.085923 Aug 31 01:31:03.727803 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 429/870] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:31:03 2022] GET /compute/v2.1/servers/7993aed7-8d74-4bd0-be09-ca60b8ad8bf1 => generated 1215 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:31:04.661121 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-806ce647-eee4-4c1d-837b-67f4b2dcd790 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:31:04.661695 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-806ce647-eee4-4c1d-837b-67f4b2dcd790 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] [instance: 1e3545f6-dc34-4bd6-b914-bcead2f56438] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:31:04.668427 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-806ce647-eee4-4c1d-837b-67f4b2dcd790 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:04.668982 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-806ce647-eee4-4c1d-837b-67f4b2dcd790 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:04.669423 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-806ce647-eee4-4c1d-837b-67f4b2dcd790 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:04.670916 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-806ce647-eee4-4c1d-837b-67f4b2dcd790 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:04.671382 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-806ce647-eee4-4c1d-837b-67f4b2dcd790 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:04.671808 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-806ce647-eee4-4c1d-837b-67f4b2dcd790 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:04.748449 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-161d651a-67aa-457b-9bc7-7795ac7a3e30 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:31:04.749253 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-161d651a-67aa-457b-9bc7-7795ac7a3e30 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] [instance: 7993aed7-8d74-4bd0-be09-ca60b8ad8bf1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:31:04.756151 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-161d651a-67aa-457b-9bc7-7795ac7a3e30 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:04.756635 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-161d651a-67aa-457b-9bc7-7795ac7a3e30 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:04.757096 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-161d651a-67aa-457b-9bc7-7795ac7a3e30 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:04.757796 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-161d651a-67aa-457b-9bc7-7795ac7a3e30 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:04.758248 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-161d651a-67aa-457b-9bc7-7795ac7a3e30 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:04.758668 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-161d651a-67aa-457b-9bc7-7795ac7a3e30 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:04.816819 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-806ce647-eee4-4c1d-837b-67f4b2dcd790 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0a7bb7fed432cadfdd79c2ddab8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9084d8c977147b7a3652e34466b2522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:31:04.825237 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-806ce647-eee4-4c1d-837b-67f4b2dcd790 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] 10.222.0.20 "GET /compute/v2.1/servers/1e3545f6-dc34-4bd6-b914-bcead2f56438" status: 200 len: 1313 microversion: 2.1 time: 0.168224 Aug 31 01:31:04.825901 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 442/871] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:31:04 2022] GET /compute/v2.1/servers/1e3545f6-dc34-4bd6-b914-bcead2f56438 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:31:04.833609 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-161d651a-67aa-457b-9bc7-7795ac7a3e30 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e944928454456cabf55a6871dd9cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c95fae9a51415b9245125f5faedb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:31:04.841442 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-161d651a-67aa-457b-9bc7-7795ac7a3e30 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] 10.222.0.20 "GET /compute/v2.1/servers/7993aed7-8d74-4bd0-be09-ca60b8ad8bf1" status: 200 len: 1271 microversion: 2.1 time: 0.096779 Aug 31 01:31:04.843249 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 430/872] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:31:04 2022] GET /compute/v2.1/servers/7993aed7-8d74-4bd0-be09-ca60b8ad8bf1 => generated 1271 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:31:05.846503 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-4059b490-7da3-4e53-8001-227ab3f7bd41 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:31:05.847123 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-4059b490-7da3-4e53-8001-227ab3f7bd41 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] [instance: 1e3545f6-dc34-4bd6-b914-bcead2f56438] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:31:05.853559 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4059b490-7da3-4e53-8001-227ab3f7bd41 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:05.854042 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4059b490-7da3-4e53-8001-227ab3f7bd41 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:05.854483 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4059b490-7da3-4e53-8001-227ab3f7bd41 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:05.855188 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4059b490-7da3-4e53-8001-227ab3f7bd41 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:05.855636 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4059b490-7da3-4e53-8001-227ab3f7bd41 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:05.856658 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4059b490-7da3-4e53-8001-227ab3f7bd41 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:05.862593 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-905d8c73-f1a5-48b8-bec9-8139bdc8b725 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:31:05.863859 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-905d8c73-f1a5-48b8-bec9-8139bdc8b725 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] [instance: 7993aed7-8d74-4bd0-be09-ca60b8ad8bf1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:31:05.866971 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell0:SELECT=2 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:31:05.872386 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-905d8c73-f1a5-48b8-bec9-8139bdc8b725 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:05.872909 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-905d8c73-f1a5-48b8-bec9-8139bdc8b725 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:05.873945 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-905d8c73-f1a5-48b8-bec9-8139bdc8b725 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:05.874629 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-905d8c73-f1a5-48b8-bec9-8139bdc8b725 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:05.875195 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-905d8c73-f1a5-48b8-bec9-8139bdc8b725 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:05.875613 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-905d8c73-f1a5-48b8-bec9-8139bdc8b725 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:06.054400 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-4059b490-7da3-4e53-8001-227ab3f7bd41 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0a7bb7fed432cadfdd79c2ddab8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9084d8c977147b7a3652e34466b2522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:31:06.062756 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-4059b490-7da3-4e53-8001-227ab3f7bd41 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] 10.222.0.20 "GET /compute/v2.1/servers/1e3545f6-dc34-4bd6-b914-bcead2f56438" status: 200 len: 1497 microversion: 2.1 time: 0.220196 Aug 31 01:31:06.063507 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 443/873] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:31:05 2022] GET /compute/v2.1/servers/1e3545f6-dc34-4bd6-b914-bcead2f56438 => generated 1497 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:31:06.074291 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-905d8c73-f1a5-48b8-bec9-8139bdc8b725 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e944928454456cabf55a6871dd9cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c95fae9a51415b9245125f5faedb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:31:06.083743 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-905d8c73-f1a5-48b8-bec9-8139bdc8b725 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] 10.222.0.20 "GET /compute/v2.1/servers/7993aed7-8d74-4bd0-be09-ca60b8ad8bf1" status: 200 len: 1319 microversion: 2.1 time: 0.224967 Aug 31 01:31:06.088757 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 431/874] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:31:05 2022] GET /compute/v2.1/servers/7993aed7-8d74-4bd0-be09-ca60b8ad8bf1 => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:31:06.699771 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-28888704-61e2-44d7-8c37-a49ce0c2f5b4 req-16f35fe4-e2b7-4f3e-85ae-fa7a5e7adb02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7993aed7-8d74-4bd0-be09-ca60b8ad8bf1", "tag": "565e763b-00ed-42fe-949e-82841645ff17"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:31:06.705115 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:31:06.710478 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-28888704-61e2-44d7-8c37-a49ce0c2f5b4 req-16f35fe4-e2b7-4f3e-85ae-fa7a5e7adb02 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:06.710946 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-28888704-61e2-44d7-8c37-a49ce0c2f5b4 req-16f35fe4-e2b7-4f3e-85ae-fa7a5e7adb02 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:06.711365 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-28888704-61e2-44d7-8c37-a49ce0c2f5b4 req-16f35fe4-e2b7-4f3e-85ae-fa7a5e7adb02 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:06.722610 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-28888704-61e2-44d7-8c37-a49ce0c2f5b4 req-16f35fe4-e2b7-4f3e-85ae-fa7a5e7adb02 service nova] Creating event network-changed:565e763b-00ed-42fe-949e-82841645ff17 for instance 7993aed7-8d74-4bd0-be09-ca60b8ad8bf1 on hv-cinder-85528 Aug 31 01:31:06.727480 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-28888704-61e2-44d7-8c37-a49ce0c2f5b4 req-16f35fe4-e2b7-4f3e-85ae-fa7a5e7adb02 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031306 Aug 31 01:31:06.728066 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 444/875] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:31:06.973156 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-e85ce1d2-855c-4862-a003-b774b4f2a139 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:31:06.973751 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-e85ce1d2-855c-4862-a003-b774b4f2a139 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] [instance: 1e3545f6-dc34-4bd6-b914-bcead2f56438] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:31:06.981053 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e85ce1d2-855c-4862-a003-b774b4f2a139 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:06.981667 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e85ce1d2-855c-4862-a003-b774b4f2a139 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:06.982162 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e85ce1d2-855c-4862-a003-b774b4f2a139 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:06.982962 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e85ce1d2-855c-4862-a003-b774b4f2a139 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:06.983470 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e85ce1d2-855c-4862-a003-b774b4f2a139 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:06.984071 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e85ce1d2-855c-4862-a003-b774b4f2a139 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:07.012039 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-e85ce1d2-855c-4862-a003-b774b4f2a139 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] [instance: 1e3545f6-dc34-4bd6-b914-bcead2f56438] Going to try to terminate instance {{(pid=121026) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 01:31:07.028654 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:31:07.106893 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-23c63752-ef93-4a69-a0c4-5b7e560add4e tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:31:07.108092 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-23c63752-ef93-4a69-a0c4-5b7e560add4e tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] [instance: 7993aed7-8d74-4bd0-be09-ca60b8ad8bf1] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:31:07.114753 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-23c63752-ef93-4a69-a0c4-5b7e560add4e tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:07.115232 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-23c63752-ef93-4a69-a0c4-5b7e560add4e tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:07.115714 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-23c63752-ef93-4a69-a0c4-5b7e560add4e tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:07.117486 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-23c63752-ef93-4a69-a0c4-5b7e560add4e tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:07.118027 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-23c63752-ef93-4a69-a0c4-5b7e560add4e tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:07.118502 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-23c63752-ef93-4a69-a0c4-5b7e560add4e tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:07.257295 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-23c63752-ef93-4a69-a0c4-5b7e560add4e tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e944928454456cabf55a6871dd9cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c95fae9a51415b9245125f5faedb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:31:07.265058 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-23c63752-ef93-4a69-a0c4-5b7e560add4e tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] 10.222.0.20 "GET /compute/v2.1/servers/7993aed7-8d74-4bd0-be09-ca60b8ad8bf1" status: 200 len: 1319 microversion: 2.1 time: 0.162928 Aug 31 01:31:07.265686 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 445/876] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:31:07 2022] GET /compute/v2.1/servers/7993aed7-8d74-4bd0-be09-ca60b8ad8bf1 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:31:07.280514 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-e85ce1d2-855c-4862-a003-b774b4f2a139 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1e3545f6-dc34-4bd6-b914-bcead2f56438" status: 204 len: 0 microversion: 2.1 time: 0.311426 Aug 31 01:31:07.281136 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 432/877] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 01:31:06 2022] DELETE /compute/v2.1/servers/1e3545f6-dc34-4bd6-b914-bcead2f56438 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 01:31:07.289038 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-9088be1d-c435-408b-a826-8d74ed4854de tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:31:07.289647 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-9088be1d-c435-408b-a826-8d74ed4854de tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] [instance: 1e3545f6-dc34-4bd6-b914-bcead2f56438] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:31:07.296274 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9088be1d-c435-408b-a826-8d74ed4854de tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:07.296804 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9088be1d-c435-408b-a826-8d74ed4854de tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:07.297276 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9088be1d-c435-408b-a826-8d74ed4854de tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:07.297977 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9088be1d-c435-408b-a826-8d74ed4854de tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:07.298436 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9088be1d-c435-408b-a826-8d74ed4854de tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:07.298862 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9088be1d-c435-408b-a826-8d74ed4854de tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:07.430407 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-9088be1d-c435-408b-a826-8d74ed4854de tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0a7bb7fed432cadfdd79c2ddab8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9084d8c977147b7a3652e34466b2522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:31:07.438666 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-9088be1d-c435-408b-a826-8d74ed4854de tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] 10.222.0.20 "GET /compute/v2.1/servers/1e3545f6-dc34-4bd6-b914-bcead2f56438" status: 200 len: 1503 microversion: 2.1 time: 0.153394 Aug 31 01:31:07.439236 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 446/878] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:31:07 2022] GET /compute/v2.1/servers/1e3545f6-dc34-4bd6-b914-bcead2f56438 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:31:08.287232 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-83a367c8-9718-425a-b5f3-fd78f39ae5d9 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:31:08.287933 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-83a367c8-9718-425a-b5f3-fd78f39ae5d9 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] [instance: 7993aed7-8d74-4bd0-be09-ca60b8ad8bf1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:31:08.294607 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-83a367c8-9718-425a-b5f3-fd78f39ae5d9 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:08.295141 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-83a367c8-9718-425a-b5f3-fd78f39ae5d9 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:08.296128 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-83a367c8-9718-425a-b5f3-fd78f39ae5d9 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:08.296849 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-83a367c8-9718-425a-b5f3-fd78f39ae5d9 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:08.297304 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-83a367c8-9718-425a-b5f3-fd78f39ae5d9 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:08.297728 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-83a367c8-9718-425a-b5f3-fd78f39ae5d9 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:08.436609 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-83a367c8-9718-425a-b5f3-fd78f39ae5d9 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e944928454456cabf55a6871dd9cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c95fae9a51415b9245125f5faedb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:31:08.444494 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-83a367c8-9718-425a-b5f3-fd78f39ae5d9 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] 10.222.0.20 "GET /compute/v2.1/servers/7993aed7-8d74-4bd0-be09-ca60b8ad8bf1" status: 200 len: 1319 microversion: 2.1 time: 0.161909 Aug 31 01:31:08.445101 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 433/879] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:31:08 2022] GET /compute/v2.1/servers/7993aed7-8d74-4bd0-be09-ca60b8ad8bf1 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:31:08.459800 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-74336118-373e-458d-bf55-27dad7204740 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:31:08.460413 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-74336118-373e-458d-bf55-27dad7204740 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] [instance: 1e3545f6-dc34-4bd6-b914-bcead2f56438] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:31:08.462439 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell0:SELECT=2 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:31:08.468379 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-74336118-373e-458d-bf55-27dad7204740 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:08.468894 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-74336118-373e-458d-bf55-27dad7204740 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:08.469335 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-74336118-373e-458d-bf55-27dad7204740 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:08.470025 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-74336118-373e-458d-bf55-27dad7204740 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:08.470477 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-74336118-373e-458d-bf55-27dad7204740 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:08.470988 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-74336118-373e-458d-bf55-27dad7204740 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:08.603549 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-74336118-373e-458d-bf55-27dad7204740 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0a7bb7fed432cadfdd79c2ddab8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9084d8c977147b7a3652e34466b2522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:31:08.611761 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-74336118-373e-458d-bf55-27dad7204740 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] 10.222.0.20 "GET /compute/v2.1/servers/1e3545f6-dc34-4bd6-b914-bcead2f56438" status: 200 len: 1503 microversion: 2.1 time: 0.156366 Aug 31 01:31:08.612363 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 447/880] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:31:08 2022] GET /compute/v2.1/servers/1e3545f6-dc34-4bd6-b914-bcead2f56438 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:31:09.468353 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-8d4b02ad-71a2-4677-9ffc-2e9c45fa161e tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:31:09.469203 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-8d4b02ad-71a2-4677-9ffc-2e9c45fa161e tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] [instance: 7993aed7-8d74-4bd0-be09-ca60b8ad8bf1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:31:09.471891 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell0:SELECT=10 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:31:09.472671 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:31:09.477530 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8d4b02ad-71a2-4677-9ffc-2e9c45fa161e tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:09.478126 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8d4b02ad-71a2-4677-9ffc-2e9c45fa161e tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:09.478659 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8d4b02ad-71a2-4677-9ffc-2e9c45fa161e tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:09.479459 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8d4b02ad-71a2-4677-9ffc-2e9c45fa161e tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:09.479970 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8d4b02ad-71a2-4677-9ffc-2e9c45fa161e tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:09.480471 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8d4b02ad-71a2-4677-9ffc-2e9c45fa161e tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:09.613840 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-8d4b02ad-71a2-4677-9ffc-2e9c45fa161e tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e944928454456cabf55a6871dd9cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c95fae9a51415b9245125f5faedb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:31:09.622036 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-8d4b02ad-71a2-4677-9ffc-2e9c45fa161e tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] 10.222.0.20 "GET /compute/v2.1/servers/7993aed7-8d74-4bd0-be09-ca60b8ad8bf1" status: 200 len: 1319 microversion: 2.1 time: 0.157885 Aug 31 01:31:09.622805 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 434/881] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:31:09 2022] GET /compute/v2.1/servers/7993aed7-8d74-4bd0-be09-ca60b8ad8bf1 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:31:09.632839 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-b6d8cf39-7bfb-4d5a-9b7d-c81cf8b0a53c tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:31:09.638754 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-b6d8cf39-7bfb-4d5a-9b7d-c81cf8b0a53c tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] [instance: 1e3545f6-dc34-4bd6-b914-bcead2f56438] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:31:09.639834 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b6d8cf39-7bfb-4d5a-9b7d-c81cf8b0a53c tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:09.640391 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b6d8cf39-7bfb-4d5a-9b7d-c81cf8b0a53c tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:09.640921 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b6d8cf39-7bfb-4d5a-9b7d-c81cf8b0a53c tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:09.641703 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b6d8cf39-7bfb-4d5a-9b7d-c81cf8b0a53c tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:09.642217 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b6d8cf39-7bfb-4d5a-9b7d-c81cf8b0a53c tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:09.642703 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b6d8cf39-7bfb-4d5a-9b7d-c81cf8b0a53c tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:09.719823 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [req-f0ae147a-2c79-45e5-b979-2baa85af0733 req-df1b3234-82cb-426d-b9db-1ce201b0605e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e3545f6-dc34-4bd6-b914-bcead2f56438", "name": "network-vif-deleted", "tag": "a93fc41f-e643-414b-b069-269e6764c25b"}]} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:31:09.722411 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-b6d8cf39-7bfb-4d5a-9b7d-c81cf8b0a53c tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0a7bb7fed432cadfdd79c2ddab8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9084d8c977147b7a3652e34466b2522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:31:09.730139 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-f0ae147a-2c79-45e5-b979-2baa85af0733 req-df1b3234-82cb-426d-b9db-1ce201b0605e service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:09.730616 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-f0ae147a-2c79-45e5-b979-2baa85af0733 req-df1b3234-82cb-426d-b9db-1ce201b0605e service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:09.730727 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-b6d8cf39-7bfb-4d5a-9b7d-c81cf8b0a53c tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] 10.222.0.20 "GET /compute/v2.1/servers/1e3545f6-dc34-4bd6-b914-bcead2f56438" status: 200 len: 1461 microversion: 2.1 time: 0.101975 Aug 31 01:31:09.731046 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-f0ae147a-2c79-45e5-b979-2baa85af0733 req-df1b3234-82cb-426d-b9db-1ce201b0605e service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:09.731272 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 448/882] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:31:09 2022] GET /compute/v2.1/servers/1e3545f6-dc34-4bd6-b914-bcead2f56438 => generated 1461 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:31:09.743021 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.compute.server_external_events [req-f0ae147a-2c79-45e5-b979-2baa85af0733 req-df1b3234-82cb-426d-b9db-1ce201b0605e service nova] Creating event network-vif-deleted:a93fc41f-e643-414b-b069-269e6764c25b for instance 1e3545f6-dc34-4bd6-b914-bcead2f56438 on hv-cinder-85528 Aug 31 01:31:09.748888 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [req-f0ae147a-2c79-45e5-b979-2baa85af0733 req-df1b3234-82cb-426d-b9db-1ce201b0605e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032408 Aug 31 01:31:09.749480 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 435/883] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:31:10.643398 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-1f5f5f60-394d-4ac8-b04c-75627e18343c tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:31:10.643984 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-1f5f5f60-394d-4ac8-b04c-75627e18343c tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] [instance: 7993aed7-8d74-4bd0-be09-ca60b8ad8bf1] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:31:10.650290 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1f5f5f60-394d-4ac8-b04c-75627e18343c tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:10.650768 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1f5f5f60-394d-4ac8-b04c-75627e18343c tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:10.651197 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1f5f5f60-394d-4ac8-b04c-75627e18343c tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:10.651904 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1f5f5f60-394d-4ac8-b04c-75627e18343c tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:10.652354 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1f5f5f60-394d-4ac8-b04c-75627e18343c tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:10.652849 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1f5f5f60-394d-4ac8-b04c-75627e18343c tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:10.752984 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-52cf55dc-ef6d-4dfa-befe-223691c007ee tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:31:10.755100 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-52cf55dc-ef6d-4dfa-befe-223691c007ee tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] [instance: 1e3545f6-dc34-4bd6-b914-bcead2f56438] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:31:10.760066 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-52cf55dc-ef6d-4dfa-befe-223691c007ee tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:10.760789 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-52cf55dc-ef6d-4dfa-befe-223691c007ee tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:10.761439 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-52cf55dc-ef6d-4dfa-befe-223691c007ee tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:10.762149 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-52cf55dc-ef6d-4dfa-befe-223691c007ee tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:10.762599 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-52cf55dc-ef6d-4dfa-befe-223691c007ee tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:10.763213 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-52cf55dc-ef6d-4dfa-befe-223691c007ee tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:10.788346 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-1f5f5f60-394d-4ac8-b04c-75627e18343c tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e944928454456cabf55a6871dd9cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c95fae9a51415b9245125f5faedb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:31:10.797023 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-1f5f5f60-394d-4ac8-b04c-75627e18343c tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] 10.222.0.20 "GET /compute/v2.1/servers/7993aed7-8d74-4bd0-be09-ca60b8ad8bf1" status: 200 len: 1319 microversion: 2.1 time: 0.157640 Aug 31 01:31:10.797874 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 449/884] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:31:10 2022] GET /compute/v2.1/servers/7993aed7-8d74-4bd0-be09-ca60b8ad8bf1 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:31:10.798736 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-52cf55dc-ef6d-4dfa-befe-223691c007ee tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:10.799223 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-52cf55dc-ef6d-4dfa-befe-223691c007ee tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:10.799659 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-52cf55dc-ef6d-4dfa-befe-223691c007ee tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:10.800105 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.objects.instance [None req-52cf55dc-ef6d-4dfa-befe-223691c007ee tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lazy-loading 'fault' on Instance uuid 1e3545f6-dc34-4bd6-b914-bcead2f56438 {{(pid=121026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:31:10.842348 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-52cf55dc-ef6d-4dfa-befe-223691c007ee tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0a7bb7fed432cadfdd79c2ddab8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9084d8c977147b7a3652e34466b2522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:31:10.850250 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-52cf55dc-ef6d-4dfa-befe-223691c007ee tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] 10.222.0.20 "GET /compute/v2.1/servers/1e3545f6-dc34-4bd6-b914-bcead2f56438" status: 200 len: 1303 microversion: 2.1 time: 0.102004 Aug 31 01:31:10.851020 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 436/885] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:31:10 2022] GET /compute/v2.1/servers/1e3545f6-dc34-4bd6-b914-bcead2f56438 => generated 1303 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:31:11.280178 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-54110a91-9551-426b-812b-5ad0d010f0f9 req-d2e1d402-d5c8-4602-a125-4d4d8e7bd740 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7993aed7-8d74-4bd0-be09-ca60b8ad8bf1", "name": "network-vif-plugged", "status": "completed", "tag": "565e763b-00ed-42fe-949e-82841645ff17"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:31:11.289603 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-54110a91-9551-426b-812b-5ad0d010f0f9 req-d2e1d402-d5c8-4602-a125-4d4d8e7bd740 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:11.290082 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-54110a91-9551-426b-812b-5ad0d010f0f9 req-d2e1d402-d5c8-4602-a125-4d4d8e7bd740 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:11.290506 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-54110a91-9551-426b-812b-5ad0d010f0f9 req-d2e1d402-d5c8-4602-a125-4d4d8e7bd740 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:11.300984 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-54110a91-9551-426b-812b-5ad0d010f0f9 req-d2e1d402-d5c8-4602-a125-4d4d8e7bd740 service nova] Creating event network-vif-plugged:565e763b-00ed-42fe-949e-82841645ff17 for instance 7993aed7-8d74-4bd0-be09-ca60b8ad8bf1 on hv-cinder-85528 Aug 31 01:31:11.305794 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-54110a91-9551-426b-812b-5ad0d010f0f9 req-d2e1d402-d5c8-4602-a125-4d4d8e7bd740 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029316 Aug 31 01:31:11.306380 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 450/886] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:31:11.818537 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-de54969a-fe8b-4aff-8c5a-9f73143f0551 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:31:11.819148 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-de54969a-fe8b-4aff-8c5a-9f73143f0551 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] [instance: 7993aed7-8d74-4bd0-be09-ca60b8ad8bf1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:31:11.825799 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-de54969a-fe8b-4aff-8c5a-9f73143f0551 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:11.826321 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-de54969a-fe8b-4aff-8c5a-9f73143f0551 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:11.826727 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-de54969a-fe8b-4aff-8c5a-9f73143f0551 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:11.827464 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-de54969a-fe8b-4aff-8c5a-9f73143f0551 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:11.827948 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-de54969a-fe8b-4aff-8c5a-9f73143f0551 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:11.828365 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-de54969a-fe8b-4aff-8c5a-9f73143f0551 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:11.869184 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell0:SELECT=12 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:31:11.874518 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-832750ff-a6de-4d77-bea4-67c3720bbad9 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:31:11.875225 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-832750ff-a6de-4d77-bea4-67c3720bbad9 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] [instance: 1e3545f6-dc34-4bd6-b914-bcead2f56438] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:31:11.881361 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-832750ff-a6de-4d77-bea4-67c3720bbad9 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:11.882543 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-832750ff-a6de-4d77-bea4-67c3720bbad9 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:11.882543 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-832750ff-a6de-4d77-bea4-67c3720bbad9 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:11.882987 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-832750ff-a6de-4d77-bea4-67c3720bbad9 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:11.883445 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-832750ff-a6de-4d77-bea4-67c3720bbad9 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:11.883871 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-832750ff-a6de-4d77-bea4-67c3720bbad9 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:11.898484 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.wsgi [None req-832750ff-a6de-4d77-bea4-67c3720bbad9 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] HTTP exception thrown: Instance 1e3545f6-dc34-4bd6-b914-bcead2f56438 could not be found. Aug 31 01:31:11.900449 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-832750ff-a6de-4d77-bea4-67c3720bbad9 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Request method failure captured: Aug 31 01:31:11.900449 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: request: GET /compute/v2.1/servers/1e3545f6-dc34-4bd6-b914-bcead2f56438 HTTP/1.1 Aug 31 01:31:11.900449 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept: application/json Aug 31 01:31:11.900449 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept-Encoding: identity Aug 31 01:31:11.900449 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Connection: close Aug 31 01:31:11.900449 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Length: 0 Aug 31 01:31:11.900449 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Type: application/json Aug 31 01:31:11.900449 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Host: 10.222.0.20 Aug 31 01:31:11.900449 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Openstack-System-Scope: None Aug 31 01:31:11.900449 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: User-Agent: python-urllib3/1.26.12 Aug 31 01:31:11.900449 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Auth-Token: gAAAAABjDrnLvLWuuxzDe_rSd383oJvyuPcbH8aHjN0ZCnNV6kCsPaQ7kTdqepoUCOhRhtaSquPA8-YulVUIRpR-QcAdwe26H8pp0nJxuILruwGFyboOoTDwmGT820Ud3avYVN_emdrtc4vvjn5RHdUWtSOSz2Mdm7_7CFSH457baChGqtwiq9o Aug 31 01:31:11.900449 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Id: None Aug 31 01:31:11.900449 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Name: None Aug 31 01:31:11.900449 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Identity-Status: Confirmed Aug 31 01:31:11.900449 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Is-Admin-Project: True Aug 31 01:31:11.900449 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Id: default Aug 31 01:31:11.900449 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Name: Default Aug 31 01:31:11.900449 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Id: f9084d8c977147b7a3652e34466b2522 Aug 31 01:31:11.900449 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Name: tempest-VolumesActionsTest-1245359200 Aug 31 01:31:11.900449 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Role: member,reader Aug 31 01:31:11.900449 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Roles: member,reader Aug 31 01:31:11.902174 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f9084d8c977147b7a3652e34466b2522"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f9084d8c977147b7a3652e34466b2522", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9084d8c977147b7a3652e34466b2522"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9084d8c977147b7a3652e34466b2522"}]}] Aug 31 01:31:11.902174 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant: tempest-VolumesActionsTest-1245359200 Aug 31 01:31:11.902174 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Id: f9084d8c977147b7a3652e34466b2522 Aug 31 01:31:11.902174 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Name: tempest-VolumesActionsTest-1245359200 Aug 31 01:31:11.902174 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User: tempest-VolumesActionsTest-1245359200-project Aug 31 01:31:11.902174 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Id: default Aug 31 01:31:11.902174 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Name: Default Aug 31 01:31:11.902174 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Id: 78b0a7bb7fed432cadfdd79c2ddab8c4 Aug 31 01:31:11.902174 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Name: tempest-VolumesActionsTest-1245359200-project Aug 31 01:31:11.902174 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: method: > Aug 31 01:31:11.902174 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: exception: Instance 1e3545f6-dc34-4bd6-b914-bcead2f56438 could not be found. Aug 31 01:31:11.902174 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: action_args: {'id': '1e3545f6-dc34-4bd6-b914-bcead2f56438'} Aug 31 01:31:11.903532 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:31:11.903532 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:31:11.903532 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:31:11.903532 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:31:11.903532 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:31:11.903532 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:31:11.903532 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:31:11.903532 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:31:11.903532 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:31:11.903532 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:31:11.903532 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e3545f6-dc34-4bd6-b914-bcead2f56438 could not be found. Aug 31 01:31:11.903532 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:31:11.903532 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:31:11.903532 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:31:11.903532 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:31:11.903532 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:31:11.903532 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:31:11.903532 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:31:11.903532 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:31:11.903532 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:31:11.909949 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:31:11.909949 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:31:11.909949 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:31:11.909949 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:31:11.909949 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:31:11.909949 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:31:11.909949 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:31:11.909949 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e3545f6-dc34-4bd6-b914-bcead2f56438 could not be found. Aug 31 01:31:11.909949 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:31:11.909949 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:31:11.909949 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:31:11.909949 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:31:11.909949 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:31:11.909949 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:31:11.909949 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:31:11.909949 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:31:11.909949 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e3545f6-dc34-4bd6-b914-bcead2f56438 could not be found. Aug 31 01:31:11.909949 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:31:11.912017 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-832750ff-a6de-4d77-bea4-67c3720bbad9 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Returning 404 to user: Instance 1e3545f6-dc34-4bd6-b914-bcead2f56438 could not be found. {{(pid=121025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:31:11.912017 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-832750ff-a6de-4d77-bea4-67c3720bbad9 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] 10.222.0.20 "GET /compute/v2.1/servers/1e3545f6-dc34-4bd6-b914-bcead2f56438" status: 404 len: 111 microversion: 2.1 time: 0.033717 Aug 31 01:31:11.912017 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 451/887] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:31:11 2022] GET /compute/v2.1/servers/1e3545f6-dc34-4bd6-b914-bcead2f56438 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 01:31:11.966910 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-de54969a-fe8b-4aff-8c5a-9f73143f0551 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e944928454456cabf55a6871dd9cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c95fae9a51415b9245125f5faedb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:31:11.974508 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-de54969a-fe8b-4aff-8c5a-9f73143f0551 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] 10.222.0.20 "GET /compute/v2.1/servers/7993aed7-8d74-4bd0-be09-ca60b8ad8bf1" status: 200 len: 1319 microversion: 2.1 time: 0.159901 Aug 31 01:31:11.975144 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 437/888] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:31:11 2022] GET /compute/v2.1/servers/7993aed7-8d74-4bd0-be09-ca60b8ad8bf1 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:31:12.003766 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-c2190fc6-1781-4984-b686-45c435319dd2 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1608536639", "imageRef": "ed6d3236-defa-4ccf-90ba-343c0d0ad58e", "flavorRef": "452", "networks": [{"uuid": "6c8eb03f-5a07-4b24-883d-dad667ce7877"}]}} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:31:12.056844 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.network.neutron [None req-c2190fc6-1781-4984-b686-45c435319dd2 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] validate_networks() for [('6c8eb03f-5a07-4b24-883d-dad667ce7877', None, None, None, None, None)] {{(pid=121025) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 01:31:12.402682 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-c2190fc6-1781-4984-b686-45c435319dd2 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Flavor limits 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 01:31:12.403105 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-c2190fc6-1781-4984-b686-45c435319dd2 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Image limits 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 01:31:12.403575 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-c2190fc6-1781-4984-b686-45c435319dd2 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Flavor pref 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 01:31:12.403999 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-c2190fc6-1781-4984-b686-45c435319dd2 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Image pref 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 01:31:12.405056 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-c2190fc6-1781-4984-b686-45c435319dd2 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 01:31:12.413847 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c2190fc6-1781-4984-b686-45c435319dd2 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:12.414326 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c2190fc6-1781-4984-b686-45c435319dd2 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:12.414754 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c2190fc6-1781-4984-b686-45c435319dd2 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:12.415471 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c2190fc6-1781-4984-b686-45c435319dd2 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:12.415921 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c2190fc6-1781-4984-b686-45c435319dd2 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:12.416346 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c2190fc6-1781-4984-b686-45c435319dd2 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:12.432460 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.quota [None req-c2190fc6-1781-4984-b686-45c435319dd2 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Getting quotas for project f9084d8c977147b7a3652e34466b2522. Resources: {'instances', 'cores', 'ram'} {{(pid=121025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 01:31:12.436402 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.quota [None req-c2190fc6-1781-4984-b686-45c435319dd2 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Getting quotas for user 78b0a7bb7fed432cadfdd79c2ddab8c4 and project f9084d8c977147b7a3652e34466b2522. Resources: {'instances', 'cores', 'ram'} {{(pid=121025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 01:31:12.446887 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-c2190fc6-1781-4984-b686-45c435319dd2 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Going to run 1 instances... {{(pid=121025) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 01:31:12.449156 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-c2190fc6-1781-4984-b686-45c435319dd2 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] [instance: c61732c0-afc4-451f-a8e4-67bb7e202eb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ed6d3236-defa-4ccf-90ba-343c0d0ad58e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 01:31:12.599638 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-c2190fc6-1781-4984-b686-45c435319dd2 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.599845 Aug 31 01:31:12.600633 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 452/889] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 31 01:31:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 01:31:12.612072 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-c8b843e7-9ab0-48a6-b633-7bdfa0cbeb80 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:31:12.613721 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-c8b843e7-9ab0-48a6-b633-7bdfa0cbeb80 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] [instance: c61732c0-afc4-451f-a8e4-67bb7e202eb6] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:31:12.664811 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-c8b843e7-9ab0-48a6-b633-7bdfa0cbeb80 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0a7bb7fed432cadfdd79c2ddab8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9084d8c977147b7a3652e34466b2522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:31:12.671622 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-c8b843e7-9ab0-48a6-b633-7bdfa0cbeb80 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] 10.222.0.20 "GET /compute/v2.1/servers/c61732c0-afc4-451f-a8e4-67bb7e202eb6" status: 200 len: 1214 microversion: 2.1 time: 0.063447 Aug 31 01:31:12.672184 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 438/890] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:31:12 2022] GET /compute/v2.1/servers/c61732c0-afc4-451f-a8e4-67bb7e202eb6 => generated 1214 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:31:12.996172 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-d3260e15-0501-45f0-8180-e5f4dae0895c tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:31:12.996817 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-d3260e15-0501-45f0-8180-e5f4dae0895c tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] [instance: 7993aed7-8d74-4bd0-be09-ca60b8ad8bf1] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:31:13.004362 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d3260e15-0501-45f0-8180-e5f4dae0895c tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:13.005025 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d3260e15-0501-45f0-8180-e5f4dae0895c tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:13.005441 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d3260e15-0501-45f0-8180-e5f4dae0895c tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:13.006178 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d3260e15-0501-45f0-8180-e5f4dae0895c tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:13.006639 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d3260e15-0501-45f0-8180-e5f4dae0895c tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:13.007103 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d3260e15-0501-45f0-8180-e5f4dae0895c tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:13.169128 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-d3260e15-0501-45f0-8180-e5f4dae0895c tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e944928454456cabf55a6871dd9cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c95fae9a51415b9245125f5faedb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:31:13.177447 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-d3260e15-0501-45f0-8180-e5f4dae0895c tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] 10.222.0.20 "GET /compute/v2.1/servers/7993aed7-8d74-4bd0-be09-ca60b8ad8bf1" status: 200 len: 1319 microversion: 2.1 time: 0.185572 Aug 31 01:31:13.178965 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 453/891] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:31:12 2022] GET /compute/v2.1/servers/7993aed7-8d74-4bd0-be09-ca60b8ad8bf1 => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:31:13.691758 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-245a113c-577c-4983-a64d-4713d180ee76 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:31:13.692367 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-245a113c-577c-4983-a64d-4713d180ee76 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] [instance: c61732c0-afc4-451f-a8e4-67bb7e202eb6] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:31:13.698802 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-245a113c-577c-4983-a64d-4713d180ee76 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:13.700627 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-245a113c-577c-4983-a64d-4713d180ee76 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:13.700627 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-245a113c-577c-4983-a64d-4713d180ee76 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:13.700627 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-245a113c-577c-4983-a64d-4713d180ee76 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:13.700955 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-245a113c-577c-4983-a64d-4713d180ee76 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:13.701254 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-245a113c-577c-4983-a64d-4713d180ee76 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:13.761576 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-245a113c-577c-4983-a64d-4713d180ee76 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0a7bb7fed432cadfdd79c2ddab8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9084d8c977147b7a3652e34466b2522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:31:13.769132 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-245a113c-577c-4983-a64d-4713d180ee76 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] 10.222.0.20 "GET /compute/v2.1/servers/c61732c0-afc4-451f-a8e4-67bb7e202eb6" status: 200 len: 1218 microversion: 2.1 time: 0.081288 Aug 31 01:31:13.769695 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 439/892] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:31:13 2022] GET /compute/v2.1/servers/c61732c0-afc4-451f-a8e4-67bb7e202eb6 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:31:14.199349 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-2e52f842-0957-4b96-89ce-6d3002629a55 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:31:14.199962 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-2e52f842-0957-4b96-89ce-6d3002629a55 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] [instance: 7993aed7-8d74-4bd0-be09-ca60b8ad8bf1] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:31:14.207049 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2e52f842-0957-4b96-89ce-6d3002629a55 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:14.207527 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2e52f842-0957-4b96-89ce-6d3002629a55 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:14.207959 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2e52f842-0957-4b96-89ce-6d3002629a55 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:14.208644 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2e52f842-0957-4b96-89ce-6d3002629a55 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:14.209153 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2e52f842-0957-4b96-89ce-6d3002629a55 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:14.209569 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2e52f842-0957-4b96-89ce-6d3002629a55 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:14.341288 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-2e52f842-0957-4b96-89ce-6d3002629a55 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e944928454456cabf55a6871dd9cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c95fae9a51415b9245125f5faedb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:31:14.348966 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-2e52f842-0957-4b96-89ce-6d3002629a55 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] 10.222.0.20 "GET /compute/v2.1/servers/7993aed7-8d74-4bd0-be09-ca60b8ad8bf1" status: 200 len: 1507 microversion: 2.1 time: 0.153414 Aug 31 01:31:14.349536 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 454/893] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:31:14 2022] GET /compute/v2.1/servers/7993aed7-8d74-4bd0-be09-ca60b8ad8bf1 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:31:14.789474 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-4f5bad23-e2c4-4c8b-8645-6b086ae520e0 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:31:14.790092 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-4f5bad23-e2c4-4c8b-8645-6b086ae520e0 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] [instance: c61732c0-afc4-451f-a8e4-67bb7e202eb6] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:31:14.796973 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4f5bad23-e2c4-4c8b-8645-6b086ae520e0 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:14.797460 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4f5bad23-e2c4-4c8b-8645-6b086ae520e0 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:14.797902 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4f5bad23-e2c4-4c8b-8645-6b086ae520e0 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:14.798594 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4f5bad23-e2c4-4c8b-8645-6b086ae520e0 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:14.799048 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4f5bad23-e2c4-4c8b-8645-6b086ae520e0 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:14.799472 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4f5bad23-e2c4-4c8b-8645-6b086ae520e0 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:14.889934 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-4f5bad23-e2c4-4c8b-8645-6b086ae520e0 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0a7bb7fed432cadfdd79c2ddab8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9084d8c977147b7a3652e34466b2522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:31:14.898208 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-4f5bad23-e2c4-4c8b-8645-6b086ae520e0 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] 10.222.0.20 "GET /compute/v2.1/servers/c61732c0-afc4-451f-a8e4-67bb7e202eb6" status: 200 len: 1284 microversion: 2.1 time: 0.112542 Aug 31 01:31:14.906783 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 440/894] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:31:14 2022] GET /compute/v2.1/servers/c61732c0-afc4-451f-a8e4-67bb7e202eb6 => generated 1284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:31:15.923864 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-39a611f3-c242-402a-b01a-0c2f734b82e8 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:31:15.924447 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-39a611f3-c242-402a-b01a-0c2f734b82e8 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] [instance: c61732c0-afc4-451f-a8e4-67bb7e202eb6] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:31:15.930972 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-39a611f3-c242-402a-b01a-0c2f734b82e8 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:15.931465 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-39a611f3-c242-402a-b01a-0c2f734b82e8 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:15.931903 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-39a611f3-c242-402a-b01a-0c2f734b82e8 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:15.932606 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-39a611f3-c242-402a-b01a-0c2f734b82e8 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:15.933096 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-39a611f3-c242-402a-b01a-0c2f734b82e8 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:15.933528 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-39a611f3-c242-402a-b01a-0c2f734b82e8 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:16.073786 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-39a611f3-c242-402a-b01a-0c2f734b82e8 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0a7bb7fed432cadfdd79c2ddab8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9084d8c977147b7a3652e34466b2522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:31:16.083150 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-39a611f3-c242-402a-b01a-0c2f734b82e8 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] 10.222.0.20 "GET /compute/v2.1/servers/c61732c0-afc4-451f-a8e4-67bb7e202eb6" status: 200 len: 1314 microversion: 2.1 time: 0.163158 Aug 31 01:31:16.083799 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 455/895] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:31:15 2022] GET /compute/v2.1/servers/c61732c0-afc4-451f-a8e4-67bb7e202eb6 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:31:16.147679 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [req-bc1d7774-00fa-48aa-91fd-74d59f1f3401 req-7084367f-9591-4fea-96be-de8928afa168 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c61732c0-afc4-451f-a8e4-67bb7e202eb6", "tag": "31c21c48-6da8-42c0-b138-9d599482967e"}]} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:31:16.158898 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-bc1d7774-00fa-48aa-91fd-74d59f1f3401 req-7084367f-9591-4fea-96be-de8928afa168 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:16.159712 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-bc1d7774-00fa-48aa-91fd-74d59f1f3401 req-7084367f-9591-4fea-96be-de8928afa168 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:16.160355 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-bc1d7774-00fa-48aa-91fd-74d59f1f3401 req-7084367f-9591-4fea-96be-de8928afa168 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:16.172885 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.compute.server_external_events [req-bc1d7774-00fa-48aa-91fd-74d59f1f3401 req-7084367f-9591-4fea-96be-de8928afa168 service nova] Creating event network-changed:31c21c48-6da8-42c0-b138-9d599482967e for instance c61732c0-afc4-451f-a8e4-67bb7e202eb6 on hv-cinder-85528 Aug 31 01:31:16.177936 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [req-bc1d7774-00fa-48aa-91fd-74d59f1f3401 req-7084367f-9591-4fea-96be-de8928afa168 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033938 Aug 31 01:31:16.178767 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 441/896] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:31:17.103542 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-c3b98d68-a48e-4395-89b1-0f0a6426f0bd tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:31:17.108681 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-c3b98d68-a48e-4395-89b1-0f0a6426f0bd tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] [instance: c61732c0-afc4-451f-a8e4-67bb7e202eb6] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:31:17.110897 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c3b98d68-a48e-4395-89b1-0f0a6426f0bd tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:17.111394 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c3b98d68-a48e-4395-89b1-0f0a6426f0bd tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:17.111829 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c3b98d68-a48e-4395-89b1-0f0a6426f0bd tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:17.112522 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c3b98d68-a48e-4395-89b1-0f0a6426f0bd tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:17.113003 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c3b98d68-a48e-4395-89b1-0f0a6426f0bd tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:17.113425 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c3b98d68-a48e-4395-89b1-0f0a6426f0bd tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:17.252399 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-c3b98d68-a48e-4395-89b1-0f0a6426f0bd tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0a7bb7fed432cadfdd79c2ddab8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9084d8c977147b7a3652e34466b2522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:31:17.259942 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-c3b98d68-a48e-4395-89b1-0f0a6426f0bd tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] 10.222.0.20 "GET /compute/v2.1/servers/c61732c0-afc4-451f-a8e4-67bb7e202eb6" status: 200 len: 1314 microversion: 2.1 time: 0.160468 Aug 31 01:31:17.260499 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 456/897] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:31:17 2022] GET /compute/v2.1/servers/c61732c0-afc4-451f-a8e4-67bb7e202eb6 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:31:18.282217 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-cd41be1d-6eba-4174-9f36-4d42c4ad5e2a tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:31:18.282919 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-cd41be1d-6eba-4174-9f36-4d42c4ad5e2a tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] [instance: c61732c0-afc4-451f-a8e4-67bb7e202eb6] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:31:18.289638 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cd41be1d-6eba-4174-9f36-4d42c4ad5e2a tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:18.290124 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cd41be1d-6eba-4174-9f36-4d42c4ad5e2a tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:18.290559 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cd41be1d-6eba-4174-9f36-4d42c4ad5e2a tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:18.291248 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cd41be1d-6eba-4174-9f36-4d42c4ad5e2a tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:18.291706 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cd41be1d-6eba-4174-9f36-4d42c4ad5e2a tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:18.292130 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cd41be1d-6eba-4174-9f36-4d42c4ad5e2a tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:18.425032 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-cd41be1d-6eba-4174-9f36-4d42c4ad5e2a tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0a7bb7fed432cadfdd79c2ddab8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9084d8c977147b7a3652e34466b2522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:31:18.433744 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-cd41be1d-6eba-4174-9f36-4d42c4ad5e2a tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] 10.222.0.20 "GET /compute/v2.1/servers/c61732c0-afc4-451f-a8e4-67bb7e202eb6" status: 200 len: 1314 microversion: 2.1 time: 0.156030 Aug 31 01:31:18.436979 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 442/898] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:31:18 2022] GET /compute/v2.1/servers/c61732c0-afc4-451f-a8e4-67bb7e202eb6 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:31:19.457776 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-6c7890a8-0643-4308-8dc7-22afa753b0ee tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:31:19.458410 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-6c7890a8-0643-4308-8dc7-22afa753b0ee tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] [instance: c61732c0-afc4-451f-a8e4-67bb7e202eb6] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:31:19.466423 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6c7890a8-0643-4308-8dc7-22afa753b0ee tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:19.466924 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6c7890a8-0643-4308-8dc7-22afa753b0ee tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:19.467350 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6c7890a8-0643-4308-8dc7-22afa753b0ee tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:19.468050 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6c7890a8-0643-4308-8dc7-22afa753b0ee tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:19.468505 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6c7890a8-0643-4308-8dc7-22afa753b0ee tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:19.469574 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6c7890a8-0643-4308-8dc7-22afa753b0ee tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:19.489322 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell1:SELECT=100 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:31:19.604261 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-6c7890a8-0643-4308-8dc7-22afa753b0ee tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0a7bb7fed432cadfdd79c2ddab8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9084d8c977147b7a3652e34466b2522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:31:19.612858 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-6c7890a8-0643-4308-8dc7-22afa753b0ee tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] 10.222.0.20 "GET /compute/v2.1/servers/c61732c0-afc4-451f-a8e4-67bb7e202eb6" status: 200 len: 1314 microversion: 2.1 time: 0.159320 Aug 31 01:31:19.613440 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 457/899] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:31:19 2022] GET /compute/v2.1/servers/c61732c0-afc4-451f-a8e4-67bb7e202eb6 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:31:20.633054 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-9b8a170c-7f7e-42e2-8c6a-d254a2882d41 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:31:20.633617 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-9b8a170c-7f7e-42e2-8c6a-d254a2882d41 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] [instance: c61732c0-afc4-451f-a8e4-67bb7e202eb6] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:31:20.640057 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9b8a170c-7f7e-42e2-8c6a-d254a2882d41 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:20.640534 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9b8a170c-7f7e-42e2-8c6a-d254a2882d41 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:20.641065 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9b8a170c-7f7e-42e2-8c6a-d254a2882d41 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:20.641808 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9b8a170c-7f7e-42e2-8c6a-d254a2882d41 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:20.642257 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9b8a170c-7f7e-42e2-8c6a-d254a2882d41 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:20.642673 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9b8a170c-7f7e-42e2-8c6a-d254a2882d41 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:20.769582 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-9b8a170c-7f7e-42e2-8c6a-d254a2882d41 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0a7bb7fed432cadfdd79c2ddab8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9084d8c977147b7a3652e34466b2522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:31:20.777010 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-9b8a170c-7f7e-42e2-8c6a-d254a2882d41 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] 10.222.0.20 "GET /compute/v2.1/servers/c61732c0-afc4-451f-a8e4-67bb7e202eb6" status: 200 len: 1314 microversion: 2.1 time: 0.148000 Aug 31 01:31:20.777569 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 443/900] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:31:20 2022] GET /compute/v2.1/servers/c61732c0-afc4-451f-a8e4-67bb7e202eb6 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:31:21.397174 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-9177ddb7-2ed5-4719-be8c-355af31c7793 req-1240c98b-a335-4552-b120-8777b9ae6581 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c61732c0-afc4-451f-a8e4-67bb7e202eb6", "name": "network-vif-plugged", "status": "completed", "tag": "31c21c48-6da8-42c0-b138-9d599482967e"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:31:21.400371 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-9177ddb7-2ed5-4719-be8c-355af31c7793 req-1240c98b-a335-4552-b120-8777b9ae6581 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:21.400894 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-9177ddb7-2ed5-4719-be8c-355af31c7793 req-1240c98b-a335-4552-b120-8777b9ae6581 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:21.401408 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-9177ddb7-2ed5-4719-be8c-355af31c7793 req-1240c98b-a335-4552-b120-8777b9ae6581 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:21.413242 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-9177ddb7-2ed5-4719-be8c-355af31c7793 req-1240c98b-a335-4552-b120-8777b9ae6581 service nova] Creating event network-vif-plugged:31c21c48-6da8-42c0-b138-9d599482967e for instance c61732c0-afc4-451f-a8e4-67bb7e202eb6 on hv-cinder-85528 Aug 31 01:31:21.418424 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-9177ddb7-2ed5-4719-be8c-355af31c7793 req-1240c98b-a335-4552-b120-8777b9ae6581 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036537 Aug 31 01:31:21.419017 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 458/901] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:31:21.799996 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-d8f94e4e-797b-4156-8bb8-d487cd849d12 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:31:21.800706 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-d8f94e4e-797b-4156-8bb8-d487cd849d12 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] [instance: c61732c0-afc4-451f-a8e4-67bb7e202eb6] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:31:21.808146 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d8f94e4e-797b-4156-8bb8-d487cd849d12 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:21.808712 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d8f94e4e-797b-4156-8bb8-d487cd849d12 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:21.809242 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d8f94e4e-797b-4156-8bb8-d487cd849d12 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:21.810010 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d8f94e4e-797b-4156-8bb8-d487cd849d12 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:21.810473 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d8f94e4e-797b-4156-8bb8-d487cd849d12 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:21.810897 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d8f94e4e-797b-4156-8bb8-d487cd849d12 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:21.948023 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-d8f94e4e-797b-4156-8bb8-d487cd849d12 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0a7bb7fed432cadfdd79c2ddab8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9084d8c977147b7a3652e34466b2522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:31:21.957599 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-d8f94e4e-797b-4156-8bb8-d487cd849d12 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] 10.222.0.20 "GET /compute/v2.1/servers/c61732c0-afc4-451f-a8e4-67bb7e202eb6" status: 200 len: 1314 microversion: 2.1 time: 0.161076 Aug 31 01:31:21.958219 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 444/902] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:31:21 2022] GET /compute/v2.1/servers/c61732c0-afc4-451f-a8e4-67bb7e202eb6 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:31:22.979546 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-dd320e3f-f26c-4ba9-91f5-dafd200d025e tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:31:22.980160 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-dd320e3f-f26c-4ba9-91f5-dafd200d025e tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] [instance: c61732c0-afc4-451f-a8e4-67bb7e202eb6] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:31:22.983766 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell0:SELECT=2 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:31:22.984378 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell0:SELECT=6 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:31:22.988173 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-dd320e3f-f26c-4ba9-91f5-dafd200d025e tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:22.988681 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-dd320e3f-f26c-4ba9-91f5-dafd200d025e tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:22.989150 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-dd320e3f-f26c-4ba9-91f5-dafd200d025e tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:22.989864 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-dd320e3f-f26c-4ba9-91f5-dafd200d025e tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:22.990319 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-dd320e3f-f26c-4ba9-91f5-dafd200d025e tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:22.990742 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-dd320e3f-f26c-4ba9-91f5-dafd200d025e tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:23.126942 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-dd320e3f-f26c-4ba9-91f5-dafd200d025e tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0a7bb7fed432cadfdd79c2ddab8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9084d8c977147b7a3652e34466b2522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:31:23.134440 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-dd320e3f-f26c-4ba9-91f5-dafd200d025e tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] 10.222.0.20 "GET /compute/v2.1/servers/c61732c0-afc4-451f-a8e4-67bb7e202eb6" status: 200 len: 1314 microversion: 2.1 time: 0.159199 Aug 31 01:31:23.134996 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 459/903] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:31:22 2022] GET /compute/v2.1/servers/c61732c0-afc4-451f-a8e4-67bb7e202eb6 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:31:24.156105 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-6ab14733-8a46-4817-9153-5540a8add5d3 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:31:24.157249 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-6ab14733-8a46-4817-9153-5540a8add5d3 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] [instance: c61732c0-afc4-451f-a8e4-67bb7e202eb6] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:31:24.159196 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell0:SELECT=2 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:31:24.164431 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6ab14733-8a46-4817-9153-5540a8add5d3 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:24.168967 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6ab14733-8a46-4817-9153-5540a8add5d3 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:24.168967 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6ab14733-8a46-4817-9153-5540a8add5d3 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:24.168967 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6ab14733-8a46-4817-9153-5540a8add5d3 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:24.168967 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6ab14733-8a46-4817-9153-5540a8add5d3 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:24.169435 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6ab14733-8a46-4817-9153-5540a8add5d3 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:24.298069 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-6ab14733-8a46-4817-9153-5540a8add5d3 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0a7bb7fed432cadfdd79c2ddab8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9084d8c977147b7a3652e34466b2522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:31:24.305736 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-6ab14733-8a46-4817-9153-5540a8add5d3 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] 10.222.0.20 "GET /compute/v2.1/servers/c61732c0-afc4-451f-a8e4-67bb7e202eb6" status: 200 len: 1497 microversion: 2.1 time: 0.153780 Aug 31 01:31:24.306300 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 445/904] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:31:24 2022] GET /compute/v2.1/servers/c61732c0-afc4-451f-a8e4-67bb7e202eb6 => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:31:25.261617 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-a14ce727-606d-448f-b15e-f0eecf320ac4 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:31:25.262133 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-a14ce727-606d-448f-b15e-f0eecf320ac4 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] [instance: c61732c0-afc4-451f-a8e4-67bb7e202eb6] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:31:25.268578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a14ce727-606d-448f-b15e-f0eecf320ac4 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:25.269096 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a14ce727-606d-448f-b15e-f0eecf320ac4 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:25.269541 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a14ce727-606d-448f-b15e-f0eecf320ac4 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:25.270235 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a14ce727-606d-448f-b15e-f0eecf320ac4 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:25.270693 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a14ce727-606d-448f-b15e-f0eecf320ac4 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:25.271135 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a14ce727-606d-448f-b15e-f0eecf320ac4 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:25.295737 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-a14ce727-606d-448f-b15e-f0eecf320ac4 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] [instance: c61732c0-afc4-451f-a8e4-67bb7e202eb6] Going to try to terminate instance {{(pid=121025) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 01:31:25.552316 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-a14ce727-606d-448f-b15e-f0eecf320ac4 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c61732c0-afc4-451f-a8e4-67bb7e202eb6" status: 204 len: 0 microversion: 2.1 time: 0.294249 Aug 31 01:31:25.553031 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 460/905] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 01:31:25 2022] DELETE /compute/v2.1/servers/c61732c0-afc4-451f-a8e4-67bb7e202eb6 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 01:31:25.561312 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-6955a110-a4cc-46b0-b2f8-d2dbfa7c89c3 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:31:25.561944 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-6955a110-a4cc-46b0-b2f8-d2dbfa7c89c3 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] [instance: c61732c0-afc4-451f-a8e4-67bb7e202eb6] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:31:25.568870 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6955a110-a4cc-46b0-b2f8-d2dbfa7c89c3 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:25.569391 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6955a110-a4cc-46b0-b2f8-d2dbfa7c89c3 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:25.569824 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6955a110-a4cc-46b0-b2f8-d2dbfa7c89c3 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:25.570522 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6955a110-a4cc-46b0-b2f8-d2dbfa7c89c3 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:25.570972 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6955a110-a4cc-46b0-b2f8-d2dbfa7c89c3 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:25.571395 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6955a110-a4cc-46b0-b2f8-d2dbfa7c89c3 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:25.703187 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-6955a110-a4cc-46b0-b2f8-d2dbfa7c89c3 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0a7bb7fed432cadfdd79c2ddab8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9084d8c977147b7a3652e34466b2522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:31:25.711139 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-6955a110-a4cc-46b0-b2f8-d2dbfa7c89c3 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] 10.222.0.20 "GET /compute/v2.1/servers/c61732c0-afc4-451f-a8e4-67bb7e202eb6" status: 200 len: 1503 microversion: 2.1 time: 0.153697 Aug 31 01:31:25.711705 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 446/906] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:31:25 2022] GET /compute/v2.1/servers/c61732c0-afc4-451f-a8e4-67bb7e202eb6 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:31:26.732906 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-eb01baba-4057-400e-8c1b-6cf16dc7931d tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:31:26.733596 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-eb01baba-4057-400e-8c1b-6cf16dc7931d tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] [instance: c61732c0-afc4-451f-a8e4-67bb7e202eb6] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:31:26.740606 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-eb01baba-4057-400e-8c1b-6cf16dc7931d tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:26.741131 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-eb01baba-4057-400e-8c1b-6cf16dc7931d tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:26.741580 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-eb01baba-4057-400e-8c1b-6cf16dc7931d tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:26.742279 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-eb01baba-4057-400e-8c1b-6cf16dc7931d tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:26.742736 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-eb01baba-4057-400e-8c1b-6cf16dc7931d tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:26.743160 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-eb01baba-4057-400e-8c1b-6cf16dc7931d tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:26.871475 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-eb01baba-4057-400e-8c1b-6cf16dc7931d tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0a7bb7fed432cadfdd79c2ddab8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9084d8c977147b7a3652e34466b2522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:31:26.879615 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-eb01baba-4057-400e-8c1b-6cf16dc7931d tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] 10.222.0.20 "GET /compute/v2.1/servers/c61732c0-afc4-451f-a8e4-67bb7e202eb6" status: 200 len: 1503 microversion: 2.1 time: 0.150898 Aug 31 01:31:26.880174 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 461/907] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:31:26 2022] GET /compute/v2.1/servers/c61732c0-afc4-451f-a8e4-67bb7e202eb6 => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:31:27.633090 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [req-f78e1732-6057-4a54-b917-9df5ce573b2b req-ac0c2416-e861-4309-97c6-8d575ed9331f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c61732c0-afc4-451f-a8e4-67bb7e202eb6", "name": "network-vif-deleted", "tag": "31c21c48-6da8-42c0-b138-9d599482967e"}]} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:31:27.643916 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-f78e1732-6057-4a54-b917-9df5ce573b2b req-ac0c2416-e861-4309-97c6-8d575ed9331f service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:27.644394 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-f78e1732-6057-4a54-b917-9df5ce573b2b req-ac0c2416-e861-4309-97c6-8d575ed9331f service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:27.644852 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-f78e1732-6057-4a54-b917-9df5ce573b2b req-ac0c2416-e861-4309-97c6-8d575ed9331f service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:27.655610 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.compute.server_external_events [req-f78e1732-6057-4a54-b917-9df5ce573b2b req-ac0c2416-e861-4309-97c6-8d575ed9331f service nova] Creating event network-vif-deleted:31c21c48-6da8-42c0-b138-9d599482967e for instance c61732c0-afc4-451f-a8e4-67bb7e202eb6 on hv-cinder-85528 Aug 31 01:31:27.664274 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [req-f78e1732-6057-4a54-b917-9df5ce573b2b req-ac0c2416-e861-4309-97c6-8d575ed9331f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032023 Aug 31 01:31:27.664274 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 447/908] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:31:27.900596 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-487ff7e7-340a-46bf-b01a-b7b832914c2b tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:31:27.901369 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-487ff7e7-340a-46bf-b01a-b7b832914c2b tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] [instance: c61732c0-afc4-451f-a8e4-67bb7e202eb6] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:31:27.910103 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-487ff7e7-340a-46bf-b01a-b7b832914c2b tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:27.910586 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-487ff7e7-340a-46bf-b01a-b7b832914c2b tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:27.911051 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-487ff7e7-340a-46bf-b01a-b7b832914c2b tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:27.911754 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-487ff7e7-340a-46bf-b01a-b7b832914c2b tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:27.912213 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-487ff7e7-340a-46bf-b01a-b7b832914c2b tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:27.912633 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-487ff7e7-340a-46bf-b01a-b7b832914c2b tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:27.944142 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-487ff7e7-340a-46bf-b01a-b7b832914c2b tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:27.944624 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-487ff7e7-340a-46bf-b01a-b7b832914c2b tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:27.945100 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-487ff7e7-340a-46bf-b01a-b7b832914c2b tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:27.945554 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.objects.instance [None req-487ff7e7-340a-46bf-b01a-b7b832914c2b tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lazy-loading 'fault' on Instance uuid c61732c0-afc4-451f-a8e4-67bb7e202eb6 {{(pid=121025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:31:27.989107 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-487ff7e7-340a-46bf-b01a-b7b832914c2b tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0a7bb7fed432cadfdd79c2ddab8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9084d8c977147b7a3652e34466b2522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:31:27.996871 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-487ff7e7-340a-46bf-b01a-b7b832914c2b tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] 10.222.0.20 "GET /compute/v2.1/servers/c61732c0-afc4-451f-a8e4-67bb7e202eb6" status: 200 len: 1304 microversion: 2.1 time: 0.100901 Aug 31 01:31:27.997474 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 462/909] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:31:27 2022] GET /compute/v2.1/servers/c61732c0-afc4-451f-a8e4-67bb7e202eb6 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:31:29.021165 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-3e44795a-2cfd-4e22-839b-b6991b869705 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:31:29.021875 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-3e44795a-2cfd-4e22-839b-b6991b869705 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] [instance: c61732c0-afc4-451f-a8e4-67bb7e202eb6] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:31:29.027933 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3e44795a-2cfd-4e22-839b-b6991b869705 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:29.028416 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3e44795a-2cfd-4e22-839b-b6991b869705 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:29.028898 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3e44795a-2cfd-4e22-839b-b6991b869705 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:29.029629 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3e44795a-2cfd-4e22-839b-b6991b869705 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:29.030088 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3e44795a-2cfd-4e22-839b-b6991b869705 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:29.030513 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3e44795a-2cfd-4e22-839b-b6991b869705 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:29.044154 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.wsgi [None req-3e44795a-2cfd-4e22-839b-b6991b869705 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] HTTP exception thrown: Instance c61732c0-afc4-451f-a8e4-67bb7e202eb6 could not be found. Aug 31 01:31:29.045825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-3e44795a-2cfd-4e22-839b-b6991b869705 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Request method failure captured: Aug 31 01:31:29.045825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: request: GET /compute/v2.1/servers/c61732c0-afc4-451f-a8e4-67bb7e202eb6 HTTP/1.1 Aug 31 01:31:29.045825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept: application/json Aug 31 01:31:29.045825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept-Encoding: identity Aug 31 01:31:29.045825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Connection: close Aug 31 01:31:29.045825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Length: 0 Aug 31 01:31:29.045825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Type: application/json Aug 31 01:31:29.045825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Host: 10.222.0.20 Aug 31 01:31:29.045825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Openstack-System-Scope: None Aug 31 01:31:29.045825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: User-Agent: python-urllib3/1.26.12 Aug 31 01:31:29.045825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Auth-Token: gAAAAABjDrnLvLWuuxzDe_rSd383oJvyuPcbH8aHjN0ZCnNV6kCsPaQ7kTdqepoUCOhRhtaSquPA8-YulVUIRpR-QcAdwe26H8pp0nJxuILruwGFyboOoTDwmGT820Ud3avYVN_emdrtc4vvjn5RHdUWtSOSz2Mdm7_7CFSH457baChGqtwiq9o Aug 31 01:31:29.045825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Id: None Aug 31 01:31:29.045825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Name: None Aug 31 01:31:29.045825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Identity-Status: Confirmed Aug 31 01:31:29.045825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Is-Admin-Project: True Aug 31 01:31:29.045825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Id: default Aug 31 01:31:29.045825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Name: Default Aug 31 01:31:29.045825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Id: f9084d8c977147b7a3652e34466b2522 Aug 31 01:31:29.045825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Name: tempest-VolumesActionsTest-1245359200 Aug 31 01:31:29.045825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Role: member,reader Aug 31 01:31:29.045825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Roles: member,reader Aug 31 01:31:29.048334 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f9084d8c977147b7a3652e34466b2522"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f9084d8c977147b7a3652e34466b2522", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9084d8c977147b7a3652e34466b2522"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9084d8c977147b7a3652e34466b2522"}]}] Aug 31 01:31:29.048334 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant: tempest-VolumesActionsTest-1245359200 Aug 31 01:31:29.048334 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Id: f9084d8c977147b7a3652e34466b2522 Aug 31 01:31:29.048334 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Name: tempest-VolumesActionsTest-1245359200 Aug 31 01:31:29.048334 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User: tempest-VolumesActionsTest-1245359200-project Aug 31 01:31:29.048334 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Id: default Aug 31 01:31:29.048334 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Name: Default Aug 31 01:31:29.048334 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Id: 78b0a7bb7fed432cadfdd79c2ddab8c4 Aug 31 01:31:29.048334 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Name: tempest-VolumesActionsTest-1245359200-project Aug 31 01:31:29.048334 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: method: > Aug 31 01:31:29.048334 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: exception: Instance c61732c0-afc4-451f-a8e4-67bb7e202eb6 could not be found. Aug 31 01:31:29.048334 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: action_args: {'id': 'c61732c0-afc4-451f-a8e4-67bb7e202eb6'} Aug 31 01:31:29.049305 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:31:29.049305 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:31:29.049305 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:31:29.049305 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:31:29.049305 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:31:29.049305 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:31:29.049305 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:31:29.049305 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:31:29.049305 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:31:29.049305 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:31:29.049305 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c61732c0-afc4-451f-a8e4-67bb7e202eb6 could not be found. Aug 31 01:31:29.049305 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:31:29.049305 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:31:29.049305 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:31:29.049305 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:31:29.049305 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:31:29.049305 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:31:29.049305 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:31:29.049305 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:31:29.049305 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:31:29.050810 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:31:29.050810 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:31:29.050810 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:31:29.050810 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:31:29.050810 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:31:29.050810 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:31:29.050810 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:31:29.050810 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c61732c0-afc4-451f-a8e4-67bb7e202eb6 could not be found. Aug 31 01:31:29.050810 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:31:29.050810 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:31:29.050810 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:31:29.050810 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:31:29.050810 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:31:29.050810 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:31:29.050810 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:31:29.050810 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:31:29.050810 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c61732c0-afc4-451f-a8e4-67bb7e202eb6 could not be found. Aug 31 01:31:29.050810 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:31:29.052141 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-3e44795a-2cfd-4e22-839b-b6991b869705 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] Returning 404 to user: Instance c61732c0-afc4-451f-a8e4-67bb7e202eb6 could not be found. {{(pid=121026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:31:29.052141 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-3e44795a-2cfd-4e22-839b-b6991b869705 tempest-VolumesActionsTest-1245359200 tempest-VolumesActionsTest-1245359200-project] 10.222.0.20 "GET /compute/v2.1/servers/c61732c0-afc4-451f-a8e4-67bb7e202eb6" status: 404 len: 111 microversion: 2.1 time: 0.031446 Aug 31 01:31:29.052141 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 448/910] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:31:29 2022] GET /compute/v2.1/servers/c61732c0-afc4-451f-a8e4-67bb7e202eb6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:31:29.824351 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-b99faab2-11f2-496f-ba5a-6e23ce323adc tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a528b6e4-150d-445c-8220-71deffbe6fa1", "device": "/dev/sdb"}} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:31:29.827291 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-b99faab2-11f2-496f-ba5a-6e23ce323adc tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] [instance: 7993aed7-8d74-4bd0-be09-ca60b8ad8bf1] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:31:29.833981 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b99faab2-11f2-496f-ba5a-6e23ce323adc tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:29.834569 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b99faab2-11f2-496f-ba5a-6e23ce323adc tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:29.835037 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b99faab2-11f2-496f-ba5a-6e23ce323adc tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:29.835717 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b99faab2-11f2-496f-ba5a-6e23ce323adc tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:29.836181 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b99faab2-11f2-496f-ba5a-6e23ce323adc tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:29.836604 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b99faab2-11f2-496f-ba5a-6e23ce323adc tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:30.527485 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-b99faab2-11f2-496f-ba5a-6e23ce323adc tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] 10.222.0.20 "POST /compute/v2.1/servers/7993aed7-8d74-4bd0-be09-ca60b8ad8bf1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.707051 Aug 31 01:31:30.528125 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 463/911] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 31 01:31:29 2022] POST /compute/v2.1/servers/7993aed7-8d74-4bd0-be09-ca60b8ad8bf1/os-volume_attachments => generated 194 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:31:58.527268 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-4fa7f1bb-ce3b-4e57-ab86-68e48a1f4b1d tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:31:58.527791 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-4fa7f1bb-ce3b-4e57-ab86-68e48a1f4b1d tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] [instance: 7993aed7-8d74-4bd0-be09-ca60b8ad8bf1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:31:58.530057 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_api:SELECT=33 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:31:58.530684 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:31:58.535310 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4fa7f1bb-ce3b-4e57-ab86-68e48a1f4b1d tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:58.535788 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4fa7f1bb-ce3b-4e57-ab86-68e48a1f4b1d tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:58.536210 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4fa7f1bb-ce3b-4e57-ab86-68e48a1f4b1d tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:58.537111 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4fa7f1bb-ce3b-4e57-ab86-68e48a1f4b1d tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:58.537575 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4fa7f1bb-ce3b-4e57-ab86-68e48a1f4b1d tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:58.537990 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-4fa7f1bb-ce3b-4e57-ab86-68e48a1f4b1d tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:58.620078 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.objects.instance [None req-4fa7f1bb-ce3b-4e57-ab86-68e48a1f4b1d tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lazy-loading 'services' on Instance uuid 7993aed7-8d74-4bd0-be09-ca60b8ad8bf1 {{(pid=121026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:31:58.859014 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-4fa7f1bb-ce3b-4e57-ab86-68e48a1f4b1d tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7993aed7-8d74-4bd0-be09-ca60b8ad8bf1/os-volume_attachments/a528b6e4-150d-445c-8220-71deffbe6fa1" status: 202 len: 0 microversion: 2.1 time: 0.335327 Aug 31 01:31:58.859649 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 449/912] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 31 01:31:58 2022] DELETE /compute/v2.1/servers/7993aed7-8d74-4bd0-be09-ca60b8ad8bf1/os-volume_attachments/a528b6e4-150d-445c-8220-71deffbe6fa1 => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 01:31:59.977674 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:31:59.978440 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:31:59.982445 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-88090bd4-d80a-4ae5-beb8-6d98234169f2 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:31:59.983035 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-88090bd4-d80a-4ae5-beb8-6d98234169f2 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] [instance: 7993aed7-8d74-4bd0-be09-ca60b8ad8bf1] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:31:59.989193 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-88090bd4-d80a-4ae5-beb8-6d98234169f2 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:59.989706 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-88090bd4-d80a-4ae5-beb8-6d98234169f2 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:59.990143 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-88090bd4-d80a-4ae5-beb8-6d98234169f2 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:31:59.991006 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-88090bd4-d80a-4ae5-beb8-6d98234169f2 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:31:59.991314 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-88090bd4-d80a-4ae5-beb8-6d98234169f2 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:31:59.991737 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-88090bd4-d80a-4ae5-beb8-6d98234169f2 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:00.017181 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-88090bd4-d80a-4ae5-beb8-6d98234169f2 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] [instance: 7993aed7-8d74-4bd0-be09-ca60b8ad8bf1] Going to try to terminate instance {{(pid=121025) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 01:32:00.311603 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-88090bd4-d80a-4ae5-beb8-6d98234169f2 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7993aed7-8d74-4bd0-be09-ca60b8ad8bf1" status: 204 len: 0 microversion: 2.1 time: 0.335345 Aug 31 01:32:00.312226 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 464/913] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 01:31:59 2022] DELETE /compute/v2.1/servers/7993aed7-8d74-4bd0-be09-ca60b8ad8bf1 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 01:32:00.322510 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-05cf8d84-a8b5-47d8-a9b2-7077e0260ed1 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:32:00.323203 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-05cf8d84-a8b5-47d8-a9b2-7077e0260ed1 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] [instance: 7993aed7-8d74-4bd0-be09-ca60b8ad8bf1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:32:00.329971 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-05cf8d84-a8b5-47d8-a9b2-7077e0260ed1 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:00.330700 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-05cf8d84-a8b5-47d8-a9b2-7077e0260ed1 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:00.331128 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-05cf8d84-a8b5-47d8-a9b2-7077e0260ed1 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:00.331807 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-05cf8d84-a8b5-47d8-a9b2-7077e0260ed1 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:00.332250 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-05cf8d84-a8b5-47d8-a9b2-7077e0260ed1 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:00.332787 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-05cf8d84-a8b5-47d8-a9b2-7077e0260ed1 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:00.461286 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-05cf8d84-a8b5-47d8-a9b2-7077e0260ed1 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e944928454456cabf55a6871dd9cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c95fae9a51415b9245125f5faedb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:32:00.468929 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-05cf8d84-a8b5-47d8-a9b2-7077e0260ed1 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] 10.222.0.20 "GET /compute/v2.1/servers/7993aed7-8d74-4bd0-be09-ca60b8ad8bf1" status: 200 len: 1513 microversion: 2.1 time: 0.151663 Aug 31 01:32:00.469496 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 450/914] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:32:00 2022] GET /compute/v2.1/servers/7993aed7-8d74-4bd0-be09-ca60b8ad8bf1 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:32:01.491231 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-3b0e9ded-a4de-4b05-82bf-2d4ce8b7ddd2 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:32:01.491934 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-3b0e9ded-a4de-4b05-82bf-2d4ce8b7ddd2 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] [instance: 7993aed7-8d74-4bd0-be09-ca60b8ad8bf1] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:32:01.499028 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3b0e9ded-a4de-4b05-82bf-2d4ce8b7ddd2 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:01.499522 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3b0e9ded-a4de-4b05-82bf-2d4ce8b7ddd2 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:01.499965 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3b0e9ded-a4de-4b05-82bf-2d4ce8b7ddd2 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:01.500667 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3b0e9ded-a4de-4b05-82bf-2d4ce8b7ddd2 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:01.501772 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3b0e9ded-a4de-4b05-82bf-2d4ce8b7ddd2 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:01.502204 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3b0e9ded-a4de-4b05-82bf-2d4ce8b7ddd2 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:01.648251 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-3b0e9ded-a4de-4b05-82bf-2d4ce8b7ddd2 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e944928454456cabf55a6871dd9cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c95fae9a51415b9245125f5faedb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:32:01.656183 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-3b0e9ded-a4de-4b05-82bf-2d4ce8b7ddd2 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] 10.222.0.20 "GET /compute/v2.1/servers/7993aed7-8d74-4bd0-be09-ca60b8ad8bf1" status: 200 len: 1513 microversion: 2.1 time: 0.170580 Aug 31 01:32:01.656782 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 465/915] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:32:01 2022] GET /compute/v2.1/servers/7993aed7-8d74-4bd0-be09-ca60b8ad8bf1 => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:32:02.370593 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [req-c625217f-d69a-4246-b57c-2eeae76c97f3 req-f0b6b1fd-6dd7-4f0f-82f4-801420299c5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7993aed7-8d74-4bd0-be09-ca60b8ad8bf1", "name": "network-vif-deleted", "tag": "565e763b-00ed-42fe-949e-82841645ff17"}]} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:32:02.379885 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-c625217f-d69a-4246-b57c-2eeae76c97f3 req-f0b6b1fd-6dd7-4f0f-82f4-801420299c5a service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:02.380482 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-c625217f-d69a-4246-b57c-2eeae76c97f3 req-f0b6b1fd-6dd7-4f0f-82f4-801420299c5a service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:02.380969 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-c625217f-d69a-4246-b57c-2eeae76c97f3 req-f0b6b1fd-6dd7-4f0f-82f4-801420299c5a service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:02.391942 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.compute.server_external_events [req-c625217f-d69a-4246-b57c-2eeae76c97f3 req-f0b6b1fd-6dd7-4f0f-82f4-801420299c5a service nova] Creating event network-vif-deleted:565e763b-00ed-42fe-949e-82841645ff17 for instance 7993aed7-8d74-4bd0-be09-ca60b8ad8bf1 on hv-cinder-85528 Aug 31 01:32:02.397711 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [req-c625217f-d69a-4246-b57c-2eeae76c97f3 req-f0b6b1fd-6dd7-4f0f-82f4-801420299c5a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031226 Aug 31 01:32:02.403718 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 451/916] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:32:02.676901 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-4d421993-6b15-4fc3-82d7-a6e159c10ee6 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:32:02.677521 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-4d421993-6b15-4fc3-82d7-a6e159c10ee6 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] [instance: 7993aed7-8d74-4bd0-be09-ca60b8ad8bf1] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:32:02.684233 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4d421993-6b15-4fc3-82d7-a6e159c10ee6 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:02.684770 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4d421993-6b15-4fc3-82d7-a6e159c10ee6 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:02.685216 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4d421993-6b15-4fc3-82d7-a6e159c10ee6 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:02.685925 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4d421993-6b15-4fc3-82d7-a6e159c10ee6 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:02.686386 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4d421993-6b15-4fc3-82d7-a6e159c10ee6 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:02.686814 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4d421993-6b15-4fc3-82d7-a6e159c10ee6 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:02.721741 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4d421993-6b15-4fc3-82d7-a6e159c10ee6 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:02.722238 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4d421993-6b15-4fc3-82d7-a6e159c10ee6 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:02.722660 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4d421993-6b15-4fc3-82d7-a6e159c10ee6 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:02.723107 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.objects.instance [None req-4d421993-6b15-4fc3-82d7-a6e159c10ee6 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lazy-loading 'fault' on Instance uuid 7993aed7-8d74-4bd0-be09-ca60b8ad8bf1 {{(pid=121025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:32:02.774211 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-4d421993-6b15-4fc3-82d7-a6e159c10ee6 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e944928454456cabf55a6871dd9cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c95fae9a51415b9245125f5faedb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:32:02.782322 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-4d421993-6b15-4fc3-82d7-a6e159c10ee6 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] 10.222.0.20 "GET /compute/v2.1/servers/7993aed7-8d74-4bd0-be09-ca60b8ad8bf1" status: 200 len: 1309 microversion: 2.1 time: 0.109359 Aug 31 01:32:02.795708 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 466/917] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:32:02 2022] GET /compute/v2.1/servers/7993aed7-8d74-4bd0-be09-ca60b8ad8bf1 => generated 1309 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:32:03.803852 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-133a5898-c73e-451a-bc06-3f94a19fbf0b tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:32:03.804580 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-133a5898-c73e-451a-bc06-3f94a19fbf0b tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] [instance: 7993aed7-8d74-4bd0-be09-ca60b8ad8bf1] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:32:03.811087 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-133a5898-c73e-451a-bc06-3f94a19fbf0b tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:03.811564 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-133a5898-c73e-451a-bc06-3f94a19fbf0b tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:03.812043 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-133a5898-c73e-451a-bc06-3f94a19fbf0b tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:03.812770 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-133a5898-c73e-451a-bc06-3f94a19fbf0b tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:03.813198 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-133a5898-c73e-451a-bc06-3f94a19fbf0b tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:03.813621 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-133a5898-c73e-451a-bc06-3f94a19fbf0b tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:03.828758 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.wsgi [None req-133a5898-c73e-451a-bc06-3f94a19fbf0b tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] HTTP exception thrown: Instance 7993aed7-8d74-4bd0-be09-ca60b8ad8bf1 could not be found. Aug 31 01:32:03.830402 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-133a5898-c73e-451a-bc06-3f94a19fbf0b tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Request method failure captured: Aug 31 01:32:03.830402 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: request: GET /compute/v2.1/servers/7993aed7-8d74-4bd0-be09-ca60b8ad8bf1 HTTP/1.1 Aug 31 01:32:03.830402 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept: application/json Aug 31 01:32:03.830402 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept-Encoding: identity Aug 31 01:32:03.830402 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Connection: close Aug 31 01:32:03.830402 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Length: 0 Aug 31 01:32:03.830402 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Type: application/json Aug 31 01:32:03.830402 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Host: 10.222.0.20 Aug 31 01:32:03.830402 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Openstack-System-Scope: None Aug 31 01:32:03.830402 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: User-Agent: python-urllib3/1.26.12 Aug 31 01:32:03.830402 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Auth-Token: gAAAAABjDrnPrunB16wtuSvIYyNo7XpfwqVAkDD2o-_hnyewTk3iHQV1Shz521eUJDN4gW0IeUHD9JZuOzFWp6ceA07H7Hb4p5FQHzaua_mMqR8wNUt0wATROYYO20zOlMxXXTcFJS1YouZ1lXMQl3q6Vg9IdYYhMSwOidGjZpPdWDQRg89XK90 Aug 31 01:32:03.830402 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Id: None Aug 31 01:32:03.830402 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Name: None Aug 31 01:32:03.830402 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Identity-Status: Confirmed Aug 31 01:32:03.830402 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Is-Admin-Project: True Aug 31 01:32:03.830402 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Id: default Aug 31 01:32:03.830402 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Name: Default Aug 31 01:32:03.830402 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Id: 29c95fae9a51415b9245125f5faedb37 Aug 31 01:32:03.830402 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2011634263 Aug 31 01:32:03.830402 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Role: member,reader Aug 31 01:32:03.830402 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Roles: member,reader Aug 31 01:32:03.832389 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/29c95fae9a51415b9245125f5faedb37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_29c95fae9a51415b9245125f5faedb37", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/29c95fae9a51415b9245125f5faedb37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/29c95fae9a51415b9245125f5faedb37"}]}] Aug 31 01:32:03.832389 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant: tempest-VolumesSnapshotTestJSON-2011634263 Aug 31 01:32:03.832389 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Id: 29c95fae9a51415b9245125f5faedb37 Aug 31 01:32:03.832389 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2011634263 Aug 31 01:32:03.832389 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User: tempest-VolumesSnapshotTestJSON-2011634263-project Aug 31 01:32:03.832389 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Id: default Aug 31 01:32:03.832389 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Name: Default Aug 31 01:32:03.832389 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Id: f3e944928454456cabf55a6871dd9cf3 Aug 31 01:32:03.832389 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Name: tempest-VolumesSnapshotTestJSON-2011634263-project Aug 31 01:32:03.832389 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: method: > Aug 31 01:32:03.832389 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: exception: Instance 7993aed7-8d74-4bd0-be09-ca60b8ad8bf1 could not be found. Aug 31 01:32:03.832389 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: action_args: {'id': '7993aed7-8d74-4bd0-be09-ca60b8ad8bf1'} Aug 31 01:32:03.833426 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:32:03.833426 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:32:03.833426 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:32:03.833426 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:32:03.833426 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:32:03.833426 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:32:03.833426 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:32:03.833426 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:32:03.833426 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:32:03.833426 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:32:03.833426 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7993aed7-8d74-4bd0-be09-ca60b8ad8bf1 could not be found. Aug 31 01:32:03.833426 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:32:03.833426 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:32:03.833426 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:32:03.833426 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:32:03.833426 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:32:03.833426 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:32:03.833426 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:32:03.833426 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:32:03.833426 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:32:03.834963 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:32:03.834963 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:32:03.834963 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:32:03.834963 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:32:03.834963 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:32:03.834963 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:32:03.834963 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:32:03.834963 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7993aed7-8d74-4bd0-be09-ca60b8ad8bf1 could not be found. Aug 31 01:32:03.834963 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:32:03.834963 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:32:03.834963 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:32:03.834963 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:32:03.834963 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:32:03.834963 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:32:03.834963 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:32:03.834963 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:32:03.834963 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7993aed7-8d74-4bd0-be09-ca60b8ad8bf1 could not be found. Aug 31 01:32:03.834963 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:32:03.836304 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-133a5898-c73e-451a-bc06-3f94a19fbf0b tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Returning 404 to user: Instance 7993aed7-8d74-4bd0-be09-ca60b8ad8bf1 could not be found. {{(pid=121026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:32:03.836304 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-133a5898-c73e-451a-bc06-3f94a19fbf0b tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] 10.222.0.20 "GET /compute/v2.1/servers/7993aed7-8d74-4bd0-be09-ca60b8ad8bf1" status: 404 len: 111 microversion: 2.1 time: 0.032474 Aug 31 01:32:03.836304 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 452/918] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:32:03 2022] GET /compute/v2.1/servers/7993aed7-8d74-4bd0-be09-ca60b8ad8bf1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:32:12.429146 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-f5e10b79-f18c-41c7-9ecd-9cc525b440ab tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-641781380", "imageRef": "ed6d3236-defa-4ccf-90ba-343c0d0ad58e", "flavorRef": "452", "networks": [{"uuid": "5ae771f9-b42a-4b35-89fa-0e126c4452ca"}]}} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:32:12.509767 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.network.neutron [None req-f5e10b79-f18c-41c7-9ecd-9cc525b440ab tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] validate_networks() for [('5ae771f9-b42a-4b35-89fa-0e126c4452ca', None, None, None, None, None)] {{(pid=121025) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 01:32:12.778975 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:32:13.005650 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-f5e10b79-f18c-41c7-9ecd-9cc525b440ab tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Flavor limits 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 01:32:13.005650 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-f5e10b79-f18c-41c7-9ecd-9cc525b440ab tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Image limits 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 01:32:13.005650 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-f5e10b79-f18c-41c7-9ecd-9cc525b440ab tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Flavor pref 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 01:32:13.006438 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-f5e10b79-f18c-41c7-9ecd-9cc525b440ab tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Image pref 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 01:32:13.007040 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-f5e10b79-f18c-41c7-9ecd-9cc525b440ab tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 01:32:13.016379 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f5e10b79-f18c-41c7-9ecd-9cc525b440ab tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:13.016874 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f5e10b79-f18c-41c7-9ecd-9cc525b440ab tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:13.017304 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f5e10b79-f18c-41c7-9ecd-9cc525b440ab tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:13.018198 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f5e10b79-f18c-41c7-9ecd-9cc525b440ab tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:13.018939 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f5e10b79-f18c-41c7-9ecd-9cc525b440ab tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:13.019374 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f5e10b79-f18c-41c7-9ecd-9cc525b440ab tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:13.039711 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.quota [None req-f5e10b79-f18c-41c7-9ecd-9cc525b440ab tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Getting quotas for project 29c95fae9a51415b9245125f5faedb37. Resources: {'instances', 'cores', 'ram'} {{(pid=121025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 01:32:13.044126 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.quota [None req-f5e10b79-f18c-41c7-9ecd-9cc525b440ab tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Getting quotas for user f3e944928454456cabf55a6871dd9cf3 and project 29c95fae9a51415b9245125f5faedb37. Resources: {'instances', 'cores', 'ram'} {{(pid=121025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 01:32:13.058277 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-f5e10b79-f18c-41c7-9ecd-9cc525b440ab tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Going to run 1 instances... {{(pid=121025) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 01:32:13.061133 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-f5e10b79-f18c-41c7-9ecd-9cc525b440ab tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] [instance: 76a0be6d-f533-4d2e-8ac5-28c894a1d4d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ed6d3236-defa-4ccf-90ba-343c0d0ad58e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 01:32:13.227850 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-f5e10b79-f18c-41c7-9ecd-9cc525b440ab tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.803413 Aug 31 01:32:13.228778 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 467/919] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 31 01:32:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 01:32:13.240489 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-2aea259c-4205-416f-a7ba-093770c37d52 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:32:13.247302 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-2aea259c-4205-416f-a7ba-093770c37d52 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] [instance: 76a0be6d-f533-4d2e-8ac5-28c894a1d4d3] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:32:13.382488 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-2aea259c-4205-416f-a7ba-093770c37d52 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e944928454456cabf55a6871dd9cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c95fae9a51415b9245125f5faedb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:32:13.393173 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-2aea259c-4205-416f-a7ba-093770c37d52 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] 10.222.0.20 "GET /compute/v2.1/servers/76a0be6d-f533-4d2e-8ac5-28c894a1d4d3" status: 200 len: 1218 microversion: 2.1 time: 0.155278 Aug 31 01:32:13.395343 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 453/920] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:32:13 2022] GET /compute/v2.1/servers/76a0be6d-f533-4d2e-8ac5-28c894a1d4d3 => generated 1218 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:32:14.417816 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-bcc32068-18b9-41c2-a3a1-70a427fc3307 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:32:14.418440 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-bcc32068-18b9-41c2-a3a1-70a427fc3307 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] [instance: 76a0be6d-f533-4d2e-8ac5-28c894a1d4d3] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:32:14.426697 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-bcc32068-18b9-41c2-a3a1-70a427fc3307 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:14.427113 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-bcc32068-18b9-41c2-a3a1-70a427fc3307 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:14.427605 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-bcc32068-18b9-41c2-a3a1-70a427fc3307 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:14.428330 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-bcc32068-18b9-41c2-a3a1-70a427fc3307 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:14.428791 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-bcc32068-18b9-41c2-a3a1-70a427fc3307 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:14.429701 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-bcc32068-18b9-41c2-a3a1-70a427fc3307 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:14.531086 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-bcc32068-18b9-41c2-a3a1-70a427fc3307 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e944928454456cabf55a6871dd9cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c95fae9a51415b9245125f5faedb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:32:14.540867 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-bcc32068-18b9-41c2-a3a1-70a427fc3307 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] 10.222.0.20 "GET /compute/v2.1/servers/76a0be6d-f533-4d2e-8ac5-28c894a1d4d3" status: 200 len: 1222 microversion: 2.1 time: 0.128984 Aug 31 01:32:14.541651 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 468/921] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:32:14 2022] GET /compute/v2.1/servers/76a0be6d-f533-4d2e-8ac5-28c894a1d4d3 => generated 1222 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:32:14.647839 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:32:14.838027 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-f7cb6b70-7aac-446f-bc14-058572b6aafb tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Action: 'create', calling method: .version_select at 0x7f1fe173b3a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1817962812", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHm7x5Ut5bEEFHKDp7GvVdhxYzyw5PUMgZyDbd7UIUlsw29JTrrQk8ovbOStemJeOtW1tgxrtWxfZC1W1xLV1IojAw5fC5LUtOcg8zh6iCQBuGx/u/EIAtiVpMOE9qSJxA=="}} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:32:14.855626 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.quota [None req-f7cb6b70-7aac-446f-bc14-058572b6aafb tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Getting quotas for project 970d06f2d1e24f0e9072a7f43bb4925b. Resources: {'key_pairs'} {{(pid=121026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 01:32:14.859629 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.quota [None req-f7cb6b70-7aac-446f-bc14-058572b6aafb tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Getting quotas for user 181421ac2d7b49d496cabfd6f205f203 and project 970d06f2d1e24f0e9072a7f43bb4925b. Resources: {'key_pairs'} {{(pid=121026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 01:32:14.872203 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f7cb6b70-7aac-446f-bc14-058572b6aafb tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [32d33fbe-9501-42bd-a766-9ae8e6bff7e1] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 01:32:15.565422 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-69d17b66-f888-4a93-a620-3b3e8da8c526 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:32:15.566153 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-69d17b66-f888-4a93-a620-3b3e8da8c526 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] [instance: 76a0be6d-f533-4d2e-8ac5-28c894a1d4d3] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:32:15.574456 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-69d17b66-f888-4a93-a620-3b3e8da8c526 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:15.575584 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-69d17b66-f888-4a93-a620-3b3e8da8c526 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:15.576034 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-69d17b66-f888-4a93-a620-3b3e8da8c526 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:15.577059 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-69d17b66-f888-4a93-a620-3b3e8da8c526 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:15.577802 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-69d17b66-f888-4a93-a620-3b3e8da8c526 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:15.578392 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-69d17b66-f888-4a93-a620-3b3e8da8c526 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:15.657459 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-69d17b66-f888-4a93-a620-3b3e8da8c526 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e944928454456cabf55a6871dd9cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c95fae9a51415b9245125f5faedb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:32:15.665345 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-69d17b66-f888-4a93-a620-3b3e8da8c526 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] 10.222.0.20 "GET /compute/v2.1/servers/76a0be6d-f533-4d2e-8ac5-28c894a1d4d3" status: 200 len: 1288 microversion: 2.1 time: 0.106548 Aug 31 01:32:15.665916 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 469/922] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:32:15 2022] GET /compute/v2.1/servers/76a0be6d-f533-4d2e-8ac5-28c894a1d4d3 => generated 1288 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:32:15.882227 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO oslo.messaging._drivers.impl_rabbit [None req-f7cb6b70-7aac-446f-bc14-058572b6aafb tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [32d33fbe-9501-42bd-a766-9ae8e6bff7e1] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 38312. Aug 31 01:32:15.948278 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-f7cb6b70-7aac-446f-bc14-058572b6aafb tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.305075 Aug 31 01:32:15.949025 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 454/923] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Aug 31 01:32:14 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:32:16.688174 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-1fe5cd3c-cb97-4701-adad-4bba6cc3c8da tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:32:16.689498 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-1fe5cd3c-cb97-4701-adad-4bba6cc3c8da tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] [instance: 76a0be6d-f533-4d2e-8ac5-28c894a1d4d3] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:32:16.696893 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1fe5cd3c-cb97-4701-adad-4bba6cc3c8da tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:16.697965 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1fe5cd3c-cb97-4701-adad-4bba6cc3c8da tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:16.698597 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1fe5cd3c-cb97-4701-adad-4bba6cc3c8da tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:16.699335 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1fe5cd3c-cb97-4701-adad-4bba6cc3c8da tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:16.699794 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1fe5cd3c-cb97-4701-adad-4bba6cc3c8da tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:16.700220 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-1fe5cd3c-cb97-4701-adad-4bba6cc3c8da tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:16.927608 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-1fe5cd3c-cb97-4701-adad-4bba6cc3c8da tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e944928454456cabf55a6871dd9cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c95fae9a51415b9245125f5faedb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:32:16.941391 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-1fe5cd3c-cb97-4701-adad-4bba6cc3c8da tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] 10.222.0.20 "GET /compute/v2.1/servers/76a0be6d-f533-4d2e-8ac5-28c894a1d4d3" status: 200 len: 1318 microversion: 2.1 time: 0.257874 Aug 31 01:32:16.952812 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 470/924] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:32:16 2022] GET /compute/v2.1/servers/76a0be6d-f533-4d2e-8ac5-28c894a1d4d3 => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:32:17.401300 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [req-41089a92-0b2e-406c-aa7e-875ca5fd967d req-5a28b92e-ce2e-4bee-9dbd-8ce799021474 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76a0be6d-f533-4d2e-8ac5-28c894a1d4d3", "tag": "f9a9283a-8f15-439f-9443-549350a01130"}]} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:32:17.419413 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-41089a92-0b2e-406c-aa7e-875ca5fd967d req-5a28b92e-ce2e-4bee-9dbd-8ce799021474 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:17.420154 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-41089a92-0b2e-406c-aa7e-875ca5fd967d req-5a28b92e-ce2e-4bee-9dbd-8ce799021474 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:17.420608 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-41089a92-0b2e-406c-aa7e-875ca5fd967d req-5a28b92e-ce2e-4bee-9dbd-8ce799021474 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:17.432707 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.compute.server_external_events [req-41089a92-0b2e-406c-aa7e-875ca5fd967d req-5a28b92e-ce2e-4bee-9dbd-8ce799021474 service nova] Creating event network-changed:f9a9283a-8f15-439f-9443-549350a01130 for instance 76a0be6d-f533-4d2e-8ac5-28c894a1d4d3 on hv-cinder-85528 Aug 31 01:32:17.437799 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [req-41089a92-0b2e-406c-aa7e-875ca5fd967d req-5a28b92e-ce2e-4bee-9dbd-8ce799021474 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040495 Aug 31 01:32:17.438825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 455/925] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:32:17.963813 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-93659245-13cc-4fd0-8cfc-beb2813a304b tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:32:17.964518 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-93659245-13cc-4fd0-8cfc-beb2813a304b tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] [instance: 76a0be6d-f533-4d2e-8ac5-28c894a1d4d3] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:32:17.972175 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-93659245-13cc-4fd0-8cfc-beb2813a304b tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:17.979339 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-93659245-13cc-4fd0-8cfc-beb2813a304b tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:17.979339 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-93659245-13cc-4fd0-8cfc-beb2813a304b tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:17.979339 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-93659245-13cc-4fd0-8cfc-beb2813a304b tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:17.979339 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-93659245-13cc-4fd0-8cfc-beb2813a304b tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:17.979852 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-93659245-13cc-4fd0-8cfc-beb2813a304b tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:18.138560 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-93659245-13cc-4fd0-8cfc-beb2813a304b tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e944928454456cabf55a6871dd9cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c95fae9a51415b9245125f5faedb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:32:18.147318 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-93659245-13cc-4fd0-8cfc-beb2813a304b tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] 10.222.0.20 "GET /compute/v2.1/servers/76a0be6d-f533-4d2e-8ac5-28c894a1d4d3" status: 200 len: 1318 microversion: 2.1 time: 0.187610 Aug 31 01:32:18.148414 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 471/926] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:32:17 2022] GET /compute/v2.1/servers/76a0be6d-f533-4d2e-8ac5-28c894a1d4d3 => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:32:19.173324 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-16f781b4-ad30-4ee7-b1c1-7b3cd36adeac tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:32:19.174138 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-16f781b4-ad30-4ee7-b1c1-7b3cd36adeac tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] [instance: 76a0be6d-f533-4d2e-8ac5-28c894a1d4d3] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:32:19.181447 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-16f781b4-ad30-4ee7-b1c1-7b3cd36adeac tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:19.181929 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-16f781b4-ad30-4ee7-b1c1-7b3cd36adeac tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:19.182360 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-16f781b4-ad30-4ee7-b1c1-7b3cd36adeac tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:19.183049 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-16f781b4-ad30-4ee7-b1c1-7b3cd36adeac tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:19.183516 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-16f781b4-ad30-4ee7-b1c1-7b3cd36adeac tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:19.183935 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-16f781b4-ad30-4ee7-b1c1-7b3cd36adeac tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:19.318155 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-16f781b4-ad30-4ee7-b1c1-7b3cd36adeac tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e944928454456cabf55a6871dd9cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c95fae9a51415b9245125f5faedb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:32:19.327243 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-16f781b4-ad30-4ee7-b1c1-7b3cd36adeac tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] 10.222.0.20 "GET /compute/v2.1/servers/76a0be6d-f533-4d2e-8ac5-28c894a1d4d3" status: 200 len: 1318 microversion: 2.1 time: 0.162027 Aug 31 01:32:19.327941 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 456/927] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:32:19 2022] GET /compute/v2.1/servers/76a0be6d-f533-4d2e-8ac5-28c894a1d4d3 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:32:20.347869 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-db445929-14e1-44a4-9710-c928205f1e7a tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:32:20.348456 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-db445929-14e1-44a4-9710-c928205f1e7a tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] [instance: 76a0be6d-f533-4d2e-8ac5-28c894a1d4d3] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:32:20.354865 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-db445929-14e1-44a4-9710-c928205f1e7a tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:20.355344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-db445929-14e1-44a4-9710-c928205f1e7a tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:20.355769 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-db445929-14e1-44a4-9710-c928205f1e7a tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:20.356449 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-db445929-14e1-44a4-9710-c928205f1e7a tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:20.356929 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-db445929-14e1-44a4-9710-c928205f1e7a tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:20.357424 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-db445929-14e1-44a4-9710-c928205f1e7a tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:20.489344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-db445929-14e1-44a4-9710-c928205f1e7a tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e944928454456cabf55a6871dd9cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c95fae9a51415b9245125f5faedb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:32:20.496995 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-db445929-14e1-44a4-9710-c928205f1e7a tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] 10.222.0.20 "GET /compute/v2.1/servers/76a0be6d-f533-4d2e-8ac5-28c894a1d4d3" status: 200 len: 1318 microversion: 2.1 time: 0.152991 Aug 31 01:32:20.497568 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 472/928] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:32:20 2022] GET /compute/v2.1/servers/76a0be6d-f533-4d2e-8ac5-28c894a1d4d3 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:32:21.518540 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-c18cb571-1190-4616-b207-eb51c9780e72 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:32:21.519166 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-c18cb571-1190-4616-b207-eb51c9780e72 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] [instance: 76a0be6d-f533-4d2e-8ac5-28c894a1d4d3] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:32:21.525682 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c18cb571-1190-4616-b207-eb51c9780e72 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:21.526167 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c18cb571-1190-4616-b207-eb51c9780e72 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:21.526606 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c18cb571-1190-4616-b207-eb51c9780e72 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:21.527298 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c18cb571-1190-4616-b207-eb51c9780e72 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:21.527758 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c18cb571-1190-4616-b207-eb51c9780e72 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:21.528177 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c18cb571-1190-4616-b207-eb51c9780e72 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:21.663312 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-c18cb571-1190-4616-b207-eb51c9780e72 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e944928454456cabf55a6871dd9cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c95fae9a51415b9245125f5faedb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:32:21.670924 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-c18cb571-1190-4616-b207-eb51c9780e72 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] 10.222.0.20 "GET /compute/v2.1/servers/76a0be6d-f533-4d2e-8ac5-28c894a1d4d3" status: 200 len: 1318 microversion: 2.1 time: 0.156344 Aug 31 01:32:21.671487 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 457/929] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:32:21 2022] GET /compute/v2.1/servers/76a0be6d-f533-4d2e-8ac5-28c894a1d4d3 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:32:22.349826 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-19fabd1e-8ff7-4063-b8af-7260318a42fd req-b712a529-92a7-4062-a04c-69611b5016ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76a0be6d-f533-4d2e-8ac5-28c894a1d4d3", "name": "network-vif-plugged", "status": "completed", "tag": "f9a9283a-8f15-439f-9443-549350a01130"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:32:22.359819 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-19fabd1e-8ff7-4063-b8af-7260318a42fd req-b712a529-92a7-4062-a04c-69611b5016ea service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:22.360301 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-19fabd1e-8ff7-4063-b8af-7260318a42fd req-b712a529-92a7-4062-a04c-69611b5016ea service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:22.361285 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-19fabd1e-8ff7-4063-b8af-7260318a42fd req-b712a529-92a7-4062-a04c-69611b5016ea service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:22.374065 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-19fabd1e-8ff7-4063-b8af-7260318a42fd req-b712a529-92a7-4062-a04c-69611b5016ea service nova] Creating event network-vif-plugged:f9a9283a-8f15-439f-9443-549350a01130 for instance 76a0be6d-f533-4d2e-8ac5-28c894a1d4d3 on hv-cinder-85528 Aug 31 01:32:22.379613 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-19fabd1e-8ff7-4063-b8af-7260318a42fd req-b712a529-92a7-4062-a04c-69611b5016ea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033490 Aug 31 01:32:22.380215 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 473/930] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:32:22.692114 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-3f926ccb-9298-4850-910b-a116a917fbdd tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:32:22.692878 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-3f926ccb-9298-4850-910b-a116a917fbdd tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] [instance: 76a0be6d-f533-4d2e-8ac5-28c894a1d4d3] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:32:22.699317 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3f926ccb-9298-4850-910b-a116a917fbdd tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:22.699795 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3f926ccb-9298-4850-910b-a116a917fbdd tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:22.700227 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3f926ccb-9298-4850-910b-a116a917fbdd tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:22.700943 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3f926ccb-9298-4850-910b-a116a917fbdd tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:22.701390 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3f926ccb-9298-4850-910b-a116a917fbdd tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:22.701807 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3f926ccb-9298-4850-910b-a116a917fbdd tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:22.935705 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-3f926ccb-9298-4850-910b-a116a917fbdd tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e944928454456cabf55a6871dd9cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c95fae9a51415b9245125f5faedb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:32:22.943409 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-3f926ccb-9298-4850-910b-a116a917fbdd tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] 10.222.0.20 "GET /compute/v2.1/servers/76a0be6d-f533-4d2e-8ac5-28c894a1d4d3" status: 200 len: 1318 microversion: 2.1 time: 0.255774 Aug 31 01:32:22.943978 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 458/931] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:32:22 2022] GET /compute/v2.1/servers/76a0be6d-f533-4d2e-8ac5-28c894a1d4d3 => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:32:23.963008 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell0:SELECT=2 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:32:23.963773 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell0:SELECT=6 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:32:23.968234 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-502f5d32-b74c-4250-97a7-2d86cb2c8c27 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:32:23.969011 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-502f5d32-b74c-4250-97a7-2d86cb2c8c27 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] [instance: 76a0be6d-f533-4d2e-8ac5-28c894a1d4d3] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:32:23.975155 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-502f5d32-b74c-4250-97a7-2d86cb2c8c27 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:23.975659 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-502f5d32-b74c-4250-97a7-2d86cb2c8c27 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:23.976117 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-502f5d32-b74c-4250-97a7-2d86cb2c8c27 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:23.976886 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-502f5d32-b74c-4250-97a7-2d86cb2c8c27 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:23.977351 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-502f5d32-b74c-4250-97a7-2d86cb2c8c27 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:23.977768 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-502f5d32-b74c-4250-97a7-2d86cb2c8c27 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:24.163795 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-502f5d32-b74c-4250-97a7-2d86cb2c8c27 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e944928454456cabf55a6871dd9cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c95fae9a51415b9245125f5faedb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:32:24.173768 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-502f5d32-b74c-4250-97a7-2d86cb2c8c27 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] 10.222.0.20 "GET /compute/v2.1/servers/76a0be6d-f533-4d2e-8ac5-28c894a1d4d3" status: 200 len: 1506 microversion: 2.1 time: 0.211048 Aug 31 01:32:24.177370 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 474/932] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:32:23 2022] GET /compute/v2.1/servers/76a0be6d-f533-4d2e-8ac5-28c894a1d4d3 => generated 1506 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:32:24.194800 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-db97e08e-1cd0-4249-8313-51bca4576bf1 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "efaeb6f2-4d47-4a11-ab43-a14320dd5dc9", "device": "/dev/sdb"}} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:32:24.197769 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-db97e08e-1cd0-4249-8313-51bca4576bf1 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] [instance: 76a0be6d-f533-4d2e-8ac5-28c894a1d4d3] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:32:24.204947 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-db97e08e-1cd0-4249-8313-51bca4576bf1 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:24.205775 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-db97e08e-1cd0-4249-8313-51bca4576bf1 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:24.206305 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-db97e08e-1cd0-4249-8313-51bca4576bf1 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:24.207114 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-db97e08e-1cd0-4249-8313-51bca4576bf1 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:24.207641 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-db97e08e-1cd0-4249-8313-51bca4576bf1 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:24.208073 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-db97e08e-1cd0-4249-8313-51bca4576bf1 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:24.867458 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell0:SELECT=6 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:32:24.910429 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-db97e08e-1cd0-4249-8313-51bca4576bf1 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] 10.222.0.20 "POST /compute/v2.1/servers/76a0be6d-f533-4d2e-8ac5-28c894a1d4d3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.719442 Aug 31 01:32:24.911045 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 459/933] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 31 01:32:24 2022] POST /compute/v2.1/servers/76a0be6d-f533-4d2e-8ac5-28c894a1d4d3/os-volume_attachments => generated 194 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:32:34.115940 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-d5cedeb6-75e9-481e-944c-252c3e2f306f tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2029366838", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1817962812", "security_groups": [{"name": "tempest-secgroup-smoke-749134086"}], "networks": [{"uuid": "8302676b-2573-43a3-9e62-be304d7b7f01"}], "block_device_mapping_v2": [{"uuid": "39b9ece1-6f47-440e-8dd1-5daa6f0314e5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:32:34.127173 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:32:34.169468 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell1:SELECT=40 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:32:34.228581 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.network.neutron [None req-d5cedeb6-75e9-481e-944c-252c3e2f306f tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] validate_networks() for [('8302676b-2573-43a3-9e62-be304d7b7f01', None, None, None, None, None)] {{(pid=121025) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 01:32:34.662994 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-d5cedeb6-75e9-481e-944c-252c3e2f306f tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Flavor limits 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 01:32:34.663419 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-d5cedeb6-75e9-481e-944c-252c3e2f306f tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Image limits 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 01:32:34.663896 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-d5cedeb6-75e9-481e-944c-252c3e2f306f tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Flavor pref 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 01:32:34.664304 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-d5cedeb6-75e9-481e-944c-252c3e2f306f tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Image pref 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 01:32:34.664717 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-d5cedeb6-75e9-481e-944c-252c3e2f306f tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 01:32:34.674710 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d5cedeb6-75e9-481e-944c-252c3e2f306f tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:34.675189 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d5cedeb6-75e9-481e-944c-252c3e2f306f tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:34.675621 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d5cedeb6-75e9-481e-944c-252c3e2f306f tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:34.676342 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d5cedeb6-75e9-481e-944c-252c3e2f306f tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:34.676821 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d5cedeb6-75e9-481e-944c-252c3e2f306f tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:34.677244 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d5cedeb6-75e9-481e-944c-252c3e2f306f tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:34.694140 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.quota [None req-d5cedeb6-75e9-481e-944c-252c3e2f306f tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Getting quotas for project 970d06f2d1e24f0e9072a7f43bb4925b. Resources: {'instances', 'cores', 'ram'} {{(pid=121025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 01:32:34.698085 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.quota [None req-d5cedeb6-75e9-481e-944c-252c3e2f306f tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Getting quotas for user 181421ac2d7b49d496cabfd6f205f203 and project 970d06f2d1e24f0e9072a7f43bb4925b. Resources: {'instances', 'cores', 'ram'} {{(pid=121025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 01:32:34.754881 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-d5cedeb6-75e9-481e-944c-252c3e2f306f tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Going to run 1 instances... {{(pid=121025) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 01:32:34.757006 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-d5cedeb6-75e9-481e-944c-252c3e2f306f tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='39b9ece1-6f47-440e-8dd1-5daa6f0314e5',volume_size=None,volume_type=None)] {{(pid=121025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 01:32:35.215961 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-d5cedeb6-75e9-481e-944c-252c3e2f306f tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.103821 Aug 31 01:32:35.216658 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 475/934] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 31 01:32:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 1105 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 01:32:35.225821 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:32:35.226736 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:32:35.230900 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-85bd46b5-1a9d-4759-8bc3-16772206788c tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:32:35.231694 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-85bd46b5-1a9d-4759-8bc3-16772206788c tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:32:35.284951 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-85bd46b5-1a9d-4759-8bc3-16772206788c tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:32:35.293193 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-85bd46b5-1a9d-4759-8bc3-16772206788c tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1089 microversion: 2.1 time: 0.068863 Aug 31 01:32:35.294126 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 460/935] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:32:35 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1089 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:32:36.314707 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-e26c6725-37c4-459a-8067-aad5736313c1 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:32:36.315117 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-e26c6725-37c4-459a-8067-aad5736313c1 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:32:36.368631 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-e26c6725-37c4-459a-8067-aad5736313c1 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:32:36.375480 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-e26c6725-37c4-459a-8067-aad5736313c1 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1089 microversion: 2.1 time: 0.065502 Aug 31 01:32:36.376550 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 476/936] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:32:36 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1089 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:32:37.396971 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-dc35ec2e-38eb-4e9b-ad6d-496882b20d34 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:32:37.397532 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-dc35ec2e-38eb-4e9b-ad6d-496882b20d34 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:32:37.404690 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-dc35ec2e-38eb-4e9b-ad6d-496882b20d34 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:37.405201 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-dc35ec2e-38eb-4e9b-ad6d-496882b20d34 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:37.405636 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-dc35ec2e-38eb-4e9b-ad6d-496882b20d34 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:37.406327 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-dc35ec2e-38eb-4e9b-ad6d-496882b20d34 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:37.406776 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-dc35ec2e-38eb-4e9b-ad6d-496882b20d34 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:37.407197 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-dc35ec2e-38eb-4e9b-ad6d-496882b20d34 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:37.469585 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-dc35ec2e-38eb-4e9b-ad6d-496882b20d34 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:32:37.477605 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-dc35ec2e-38eb-4e9b-ad6d-496882b20d34 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1187 microversion: 2.1 time: 0.085880 Aug 31 01:32:37.478176 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 461/937] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:32:37 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1187 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:32:38.498573 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-c7a83078-6be7-41a1-a85d-42a47e76db1b tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:32:38.499115 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-c7a83078-6be7-41a1-a85d-42a47e76db1b tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:32:38.505753 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c7a83078-6be7-41a1-a85d-42a47e76db1b tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:38.506284 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c7a83078-6be7-41a1-a85d-42a47e76db1b tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:38.511493 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c7a83078-6be7-41a1-a85d-42a47e76db1b tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:38.511493 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c7a83078-6be7-41a1-a85d-42a47e76db1b tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:38.511493 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c7a83078-6be7-41a1-a85d-42a47e76db1b tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:38.511493 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c7a83078-6be7-41a1-a85d-42a47e76db1b tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:38.571832 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-c7a83078-6be7-41a1-a85d-42a47e76db1b tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:32:38.579667 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-c7a83078-6be7-41a1-a85d-42a47e76db1b tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1195 microversion: 2.1 time: 0.085150 Aug 31 01:32:38.580259 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 477/938] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:32:38 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1195 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:32:39.600848 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-e76fa3a3-ed4c-42c3-97bd-fe36ddafc316 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:32:39.601369 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-e76fa3a3-ed4c-42c3-97bd-fe36ddafc316 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:32:39.607659 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e76fa3a3-ed4c-42c3-97bd-fe36ddafc316 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:39.608142 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e76fa3a3-ed4c-42c3-97bd-fe36ddafc316 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:39.608577 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e76fa3a3-ed4c-42c3-97bd-fe36ddafc316 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:39.609293 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e76fa3a3-ed4c-42c3-97bd-fe36ddafc316 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:39.609745 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e76fa3a3-ed4c-42c3-97bd-fe36ddafc316 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:39.610164 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e76fa3a3-ed4c-42c3-97bd-fe36ddafc316 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:39.671153 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-e76fa3a3-ed4c-42c3-97bd-fe36ddafc316 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:32:39.679394 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-e76fa3a3-ed4c-42c3-97bd-fe36ddafc316 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1205 microversion: 2.1 time: 0.082572 Aug 31 01:32:39.679960 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 462/939] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:32:39 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1205 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:32:40.703708 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-51721746-2fe2-4388-a352-b532e01f802c tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:32:40.704311 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-51721746-2fe2-4388-a352-b532e01f802c tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:32:40.711088 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-51721746-2fe2-4388-a352-b532e01f802c tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:40.711552 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-51721746-2fe2-4388-a352-b532e01f802c tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:40.711981 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-51721746-2fe2-4388-a352-b532e01f802c tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:40.712657 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-51721746-2fe2-4388-a352-b532e01f802c tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:40.713132 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-51721746-2fe2-4388-a352-b532e01f802c tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:40.713547 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-51721746-2fe2-4388-a352-b532e01f802c tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:40.774530 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-51721746-2fe2-4388-a352-b532e01f802c tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:32:40.782055 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-51721746-2fe2-4388-a352-b532e01f802c tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1205 microversion: 2.1 time: 0.082329 Aug 31 01:32:40.782827 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 478/940] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:32:40 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1205 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:32:41.789757 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [req-5ac4c7d8-8e09-438e-8631-f169640b0381 req-8633ae5c-4f11-402c-9615-93e2e2f1fbe0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a8fe146-0b7b-4588-b312-2a525c4ca249", "tag": "51e05401-efe1-4123-a876-e27cdccec893"}]} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:32:41.800533 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-5ac4c7d8-8e09-438e-8631-f169640b0381 req-8633ae5c-4f11-402c-9615-93e2e2f1fbe0 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:41.803870 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-5ac4c7d8-8e09-438e-8631-f169640b0381 req-8633ae5c-4f11-402c-9615-93e2e2f1fbe0 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:41.803870 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-5ac4c7d8-8e09-438e-8631-f169640b0381 req-8633ae5c-4f11-402c-9615-93e2e2f1fbe0 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:41.804060 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-5edc3d4a-ad17-484c-90a9-e14b77eb7e65 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:32:41.805098 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-5edc3d4a-ad17-484c-90a9-e14b77eb7e65 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:32:41.812793 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5edc3d4a-ad17-484c-90a9-e14b77eb7e65 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:41.813254 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.compute.server_external_events [req-5ac4c7d8-8e09-438e-8631-f169640b0381 req-8633ae5c-4f11-402c-9615-93e2e2f1fbe0 service nova] Creating event network-changed:51e05401-efe1-4123-a876-e27cdccec893 for instance 9a8fe146-0b7b-4588-b312-2a525c4ca249 on hv-cinder-85528 Aug 31 01:32:41.813500 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5edc3d4a-ad17-484c-90a9-e14b77eb7e65 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:41.814030 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5edc3d4a-ad17-484c-90a9-e14b77eb7e65 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:41.814855 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5edc3d4a-ad17-484c-90a9-e14b77eb7e65 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:41.815481 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5edc3d4a-ad17-484c-90a9-e14b77eb7e65 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:41.815993 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5edc3d4a-ad17-484c-90a9-e14b77eb7e65 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:41.818432 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [req-5ac4c7d8-8e09-438e-8631-f169640b0381 req-8633ae5c-4f11-402c-9615-93e2e2f1fbe0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032550 Aug 31 01:32:41.819339 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 463/941] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:32:41.963090 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-5edc3d4a-ad17-484c-90a9-e14b77eb7e65 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:32:41.966510 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-5edc3d4a-ad17-484c-90a9-e14b77eb7e65 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1260 microversion: 2.1 time: 0.167395 Aug 31 01:32:41.967092 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 479/942] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:32:41 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:32:42.988942 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-af8387c9-c431-4f37-87e0-1edab5857415 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:32:42.990312 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-af8387c9-c431-4f37-87e0-1edab5857415 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:32:42.996517 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-af8387c9-c431-4f37-87e0-1edab5857415 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:42.997045 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-af8387c9-c431-4f37-87e0-1edab5857415 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:42.997450 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-af8387c9-c431-4f37-87e0-1edab5857415 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:42.998131 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-af8387c9-c431-4f37-87e0-1edab5857415 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:42.998575 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-af8387c9-c431-4f37-87e0-1edab5857415 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:42.998990 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-af8387c9-c431-4f37-87e0-1edab5857415 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:43.127444 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-af8387c9-c431-4f37-87e0-1edab5857415 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:32:43.135087 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-af8387c9-c431-4f37-87e0-1edab5857415 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1260 microversion: 2.1 time: 0.150885 Aug 31 01:32:43.135649 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 464/943] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:32:42 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:32:44.155723 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-b681afd2-8cd8-44a9-b81e-cdfdad5f33a5 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:32:44.156282 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-b681afd2-8cd8-44a9-b81e-cdfdad5f33a5 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:32:44.163387 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b681afd2-8cd8-44a9-b81e-cdfdad5f33a5 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:44.165093 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b681afd2-8cd8-44a9-b81e-cdfdad5f33a5 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:44.165093 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b681afd2-8cd8-44a9-b81e-cdfdad5f33a5 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:44.165093 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b681afd2-8cd8-44a9-b81e-cdfdad5f33a5 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:44.165561 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b681afd2-8cd8-44a9-b81e-cdfdad5f33a5 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:44.165978 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b681afd2-8cd8-44a9-b81e-cdfdad5f33a5 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:44.299456 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-b681afd2-8cd8-44a9-b81e-cdfdad5f33a5 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:32:44.308539 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-b681afd2-8cd8-44a9-b81e-cdfdad5f33a5 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1260 microversion: 2.1 time: 0.156857 Aug 31 01:32:44.309258 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 480/944] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:32:44 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:32:44.811264 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-5e5147a8-81bc-4b01-9d04-d1fd219d6525 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:32:44.811754 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-5e5147a8-81bc-4b01-9d04-d1fd219d6525 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] [instance: 76a0be6d-f533-4d2e-8ac5-28c894a1d4d3] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:32:44.818887 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5e5147a8-81bc-4b01-9d04-d1fd219d6525 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:44.824104 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5e5147a8-81bc-4b01-9d04-d1fd219d6525 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:44.824104 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5e5147a8-81bc-4b01-9d04-d1fd219d6525 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:44.824104 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5e5147a8-81bc-4b01-9d04-d1fd219d6525 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:44.824104 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5e5147a8-81bc-4b01-9d04-d1fd219d6525 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:44.824493 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5e5147a8-81bc-4b01-9d04-d1fd219d6525 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:44.901033 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.objects.instance [None req-5e5147a8-81bc-4b01-9d04-d1fd219d6525 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lazy-loading 'services' on Instance uuid 76a0be6d-f533-4d2e-8ac5-28c894a1d4d3 {{(pid=121026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:32:45.115206 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-5e5147a8-81bc-4b01-9d04-d1fd219d6525 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] 10.222.0.20 "DELETE /compute/v2.1/servers/76a0be6d-f533-4d2e-8ac5-28c894a1d4d3/os-volume_attachments/efaeb6f2-4d47-4a11-ab43-a14320dd5dc9" status: 202 len: 0 microversion: 2.1 time: 0.307894 Aug 31 01:32:45.115744 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 465/945] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 31 01:32:44 2022] DELETE /compute/v2.1/servers/76a0be6d-f533-4d2e-8ac5-28c894a1d4d3/os-volume_attachments/efaeb6f2-4d47-4a11-ab43-a14320dd5dc9 => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 01:32:45.328920 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-3f16cd8e-abd2-4efc-a712-0cc639d3a934 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:32:45.329568 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-3f16cd8e-abd2-4efc-a712-0cc639d3a934 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:32:45.331662 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell0:SELECT=2 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:32:45.336854 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3f16cd8e-abd2-4efc-a712-0cc639d3a934 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:45.337340 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3f16cd8e-abd2-4efc-a712-0cc639d3a934 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:45.337772 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3f16cd8e-abd2-4efc-a712-0cc639d3a934 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:45.338451 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3f16cd8e-abd2-4efc-a712-0cc639d3a934 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:45.338901 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3f16cd8e-abd2-4efc-a712-0cc639d3a934 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:45.339321 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3f16cd8e-abd2-4efc-a712-0cc639d3a934 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:45.474622 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-3f16cd8e-abd2-4efc-a712-0cc639d3a934 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:32:45.482338 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-3f16cd8e-abd2-4efc-a712-0cc639d3a934 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1260 microversion: 2.1 time: 0.157268 Aug 31 01:32:45.482901 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 481/946] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:32:45 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:32:46.233661 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell0:SELECT=2 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:32:46.238469 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-1c6819c4-19a5-46bb-965f-9dd475c04be8 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:32:46.239121 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-1c6819c4-19a5-46bb-965f-9dd475c04be8 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] [instance: 76a0be6d-f533-4d2e-8ac5-28c894a1d4d3] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:32:46.245654 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1c6819c4-19a5-46bb-965f-9dd475c04be8 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:46.246142 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1c6819c4-19a5-46bb-965f-9dd475c04be8 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:46.246575 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1c6819c4-19a5-46bb-965f-9dd475c04be8 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:46.247299 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1c6819c4-19a5-46bb-965f-9dd475c04be8 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:46.247753 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1c6819c4-19a5-46bb-965f-9dd475c04be8 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:46.248174 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1c6819c4-19a5-46bb-965f-9dd475c04be8 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:46.274548 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-1c6819c4-19a5-46bb-965f-9dd475c04be8 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] [instance: 76a0be6d-f533-4d2e-8ac5-28c894a1d4d3] Going to try to terminate instance {{(pid=121026) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 01:32:46.333609 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-bd6e30cd-1cf0-44bf-90ca-fa3c4652d014 req-c16c2424-77f0-4b11-9423-48e046ac23a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a8fe146-0b7b-4588-b312-2a525c4ca249", "name": "network-vif-plugged", "status": "completed", "tag": "51e05401-efe1-4123-a876-e27cdccec893"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:32:46.343286 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-bd6e30cd-1cf0-44bf-90ca-fa3c4652d014 req-c16c2424-77f0-4b11-9423-48e046ac23a1 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:46.346610 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-bd6e30cd-1cf0-44bf-90ca-fa3c4652d014 req-c16c2424-77f0-4b11-9423-48e046ac23a1 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:46.346610 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-bd6e30cd-1cf0-44bf-90ca-fa3c4652d014 req-c16c2424-77f0-4b11-9423-48e046ac23a1 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:46.355066 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-bd6e30cd-1cf0-44bf-90ca-fa3c4652d014 req-c16c2424-77f0-4b11-9423-48e046ac23a1 service nova] Creating event network-vif-plugged:51e05401-efe1-4123-a876-e27cdccec893 for instance 9a8fe146-0b7b-4588-b312-2a525c4ca249 on hv-cinder-85528 Aug 31 01:32:46.359995 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-bd6e30cd-1cf0-44bf-90ca-fa3c4652d014 req-c16c2424-77f0-4b11-9423-48e046ac23a1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030400 Aug 31 01:32:46.360590 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 482/947] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:32:46.500007 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell0:SELECT=8 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:32:46.504787 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-953f1a16-ada0-4e46-a2b2-b8a850408351 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:32:46.505485 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-953f1a16-ada0-4e46-a2b2-b8a850408351 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:32:46.511984 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-953f1a16-ada0-4e46-a2b2-b8a850408351 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:46.512711 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-953f1a16-ada0-4e46-a2b2-b8a850408351 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:46.513178 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-953f1a16-ada0-4e46-a2b2-b8a850408351 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:46.513913 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-953f1a16-ada0-4e46-a2b2-b8a850408351 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:46.514332 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-953f1a16-ada0-4e46-a2b2-b8a850408351 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:46.514754 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-953f1a16-ada0-4e46-a2b2-b8a850408351 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:46.567990 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-1c6819c4-19a5-46bb-965f-9dd475c04be8 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] 10.222.0.20 "DELETE /compute/v2.1/servers/76a0be6d-f533-4d2e-8ac5-28c894a1d4d3" status: 204 len: 0 microversion: 2.1 time: 0.335049 Aug 31 01:32:46.568600 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 466/948] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 01:32:46 2022] DELETE /compute/v2.1/servers/76a0be6d-f533-4d2e-8ac5-28c894a1d4d3 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 01:32:46.577138 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-72f80564-e056-463b-a1ac-3c527f193272 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:32:46.577832 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-72f80564-e056-463b-a1ac-3c527f193272 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] [instance: 76a0be6d-f533-4d2e-8ac5-28c894a1d4d3] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:32:46.584367 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-72f80564-e056-463b-a1ac-3c527f193272 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:46.584893 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-72f80564-e056-463b-a1ac-3c527f193272 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:46.585333 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-72f80564-e056-463b-a1ac-3c527f193272 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:46.586064 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-72f80564-e056-463b-a1ac-3c527f193272 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:46.586556 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-72f80564-e056-463b-a1ac-3c527f193272 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:46.586980 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-72f80564-e056-463b-a1ac-3c527f193272 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:46.683779 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-953f1a16-ada0-4e46-a2b2-b8a850408351 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:32:46.691678 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-953f1a16-ada0-4e46-a2b2-b8a850408351 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1260 microversion: 2.1 time: 0.192553 Aug 31 01:32:46.692257 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 483/949] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:32:46 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1260 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:32:46.742500 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-72f80564-e056-463b-a1ac-3c527f193272 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e944928454456cabf55a6871dd9cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c95fae9a51415b9245125f5faedb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:32:46.750206 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-72f80564-e056-463b-a1ac-3c527f193272 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] 10.222.0.20 "GET /compute/v2.1/servers/76a0be6d-f533-4d2e-8ac5-28c894a1d4d3" status: 200 len: 1512 microversion: 2.1 time: 0.177265 Aug 31 01:32:46.750762 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 467/950] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:32:46 2022] GET /compute/v2.1/servers/76a0be6d-f533-4d2e-8ac5-28c894a1d4d3 => generated 1512 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:32:47.713218 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-d0af1619-5f34-4b7d-a2e1-42d9258cbc00 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:32:47.713831 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-d0af1619-5f34-4b7d-a2e1-42d9258cbc00 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:32:47.720697 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d0af1619-5f34-4b7d-a2e1-42d9258cbc00 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:47.721212 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d0af1619-5f34-4b7d-a2e1-42d9258cbc00 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:47.721652 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d0af1619-5f34-4b7d-a2e1-42d9258cbc00 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:47.722341 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d0af1619-5f34-4b7d-a2e1-42d9258cbc00 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:47.722799 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d0af1619-5f34-4b7d-a2e1-42d9258cbc00 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:47.723224 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-d0af1619-5f34-4b7d-a2e1-42d9258cbc00 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:47.771713 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-22b0fa5e-21b0-4419-82b1-8acf7080ea4c tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:32:47.772316 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-22b0fa5e-21b0-4419-82b1-8acf7080ea4c tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] [instance: 76a0be6d-f533-4d2e-8ac5-28c894a1d4d3] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:32:47.779033 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-22b0fa5e-21b0-4419-82b1-8acf7080ea4c tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:47.779506 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-22b0fa5e-21b0-4419-82b1-8acf7080ea4c tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:47.779934 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-22b0fa5e-21b0-4419-82b1-8acf7080ea4c tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:47.780618 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-22b0fa5e-21b0-4419-82b1-8acf7080ea4c tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:47.781093 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-22b0fa5e-21b0-4419-82b1-8acf7080ea4c tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:47.781508 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-22b0fa5e-21b0-4419-82b1-8acf7080ea4c tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:47.891352 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-d0af1619-5f34-4b7d-a2e1-42d9258cbc00 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:32:47.903074 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-d0af1619-5f34-4b7d-a2e1-42d9258cbc00 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1260 microversion: 2.1 time: 0.193672 Aug 31 01:32:47.903751 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 484/951] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:32:47 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1260 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:32:47.938346 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-22b0fa5e-21b0-4419-82b1-8acf7080ea4c tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e944928454456cabf55a6871dd9cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c95fae9a51415b9245125f5faedb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:32:47.946795 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-22b0fa5e-21b0-4419-82b1-8acf7080ea4c tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] 10.222.0.20 "GET /compute/v2.1/servers/76a0be6d-f533-4d2e-8ac5-28c894a1d4d3" status: 200 len: 1512 microversion: 2.1 time: 0.179628 Aug 31 01:32:47.947352 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 468/952] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:32:47 2022] GET /compute/v2.1/servers/76a0be6d-f533-4d2e-8ac5-28c894a1d4d3 => generated 1512 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:32:48.879247 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-af3125be-0e7a-49e8-b8f5-b1e9f518b61d req-8002c117-fe11-47da-af64-e5bcdd03e791 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76a0be6d-f533-4d2e-8ac5-28c894a1d4d3", "name": "network-vif-deleted", "tag": "f9a9283a-8f15-439f-9443-549350a01130"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:32:48.889318 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-af3125be-0e7a-49e8-b8f5-b1e9f518b61d req-8002c117-fe11-47da-af64-e5bcdd03e791 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:48.889798 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-af3125be-0e7a-49e8-b8f5-b1e9f518b61d req-8002c117-fe11-47da-af64-e5bcdd03e791 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:48.893665 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-af3125be-0e7a-49e8-b8f5-b1e9f518b61d req-8002c117-fe11-47da-af64-e5bcdd03e791 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:48.902512 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-af3125be-0e7a-49e8-b8f5-b1e9f518b61d req-8002c117-fe11-47da-af64-e5bcdd03e791 service nova] Creating event network-vif-deleted:f9a9283a-8f15-439f-9443-549350a01130 for instance 76a0be6d-f533-4d2e-8ac5-28c894a1d4d3 on hv-cinder-85528 Aug 31 01:32:48.907627 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-af3125be-0e7a-49e8-b8f5-b1e9f518b61d req-8002c117-fe11-47da-af64-e5bcdd03e791 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032010 Aug 31 01:32:48.908232 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 485/953] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:32:48.924058 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-1e1a9a79-e720-4cb5-a5e9-0c0ffa1567d7 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:32:48.929412 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-1e1a9a79-e720-4cb5-a5e9-0c0ffa1567d7 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:32:48.930625 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1e1a9a79-e720-4cb5-a5e9-0c0ffa1567d7 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:48.931118 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1e1a9a79-e720-4cb5-a5e9-0c0ffa1567d7 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:48.931553 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1e1a9a79-e720-4cb5-a5e9-0c0ffa1567d7 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:48.932244 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1e1a9a79-e720-4cb5-a5e9-0c0ffa1567d7 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:48.932699 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1e1a9a79-e720-4cb5-a5e9-0c0ffa1567d7 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:48.933148 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1e1a9a79-e720-4cb5-a5e9-0c0ffa1567d7 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:48.968093 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-09c1c429-37f4-448d-bc49-29c4a33ca138 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:32:48.968834 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-09c1c429-37f4-448d-bc49-29c4a33ca138 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] [instance: 76a0be6d-f533-4d2e-8ac5-28c894a1d4d3] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:32:48.975281 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-09c1c429-37f4-448d-bc49-29c4a33ca138 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:48.975768 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-09c1c429-37f4-448d-bc49-29c4a33ca138 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:48.976197 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-09c1c429-37f4-448d-bc49-29c4a33ca138 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:48.976924 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-09c1c429-37f4-448d-bc49-29c4a33ca138 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:48.977370 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-09c1c429-37f4-448d-bc49-29c4a33ca138 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:48.977832 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-09c1c429-37f4-448d-bc49-29c4a33ca138 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:49.053601 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-09c1c429-37f4-448d-bc49-29c4a33ca138 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e944928454456cabf55a6871dd9cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c95fae9a51415b9245125f5faedb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:32:49.062909 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-09c1c429-37f4-448d-bc49-29c4a33ca138 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] 10.222.0.20 "GET /compute/v2.1/servers/76a0be6d-f533-4d2e-8ac5-28c894a1d4d3" status: 200 len: 1470 microversion: 2.1 time: 0.098511 Aug 31 01:32:49.063508 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 486/954] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:32:48 2022] GET /compute/v2.1/servers/76a0be6d-f533-4d2e-8ac5-28c894a1d4d3 => generated 1470 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:32:49.088604 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-1e1a9a79-e720-4cb5-a5e9-0c0ffa1567d7 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:32:49.096770 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-1e1a9a79-e720-4cb5-a5e9-0c0ffa1567d7 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1260 microversion: 2.1 time: 0.177047 Aug 31 01:32:49.097579 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 469/955] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:32:48 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:32:50.085452 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-7acb1c27-7e33-4966-830c-bf5d6f1bd7d2 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:32:50.086009 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-7acb1c27-7e33-4966-830c-bf5d6f1bd7d2 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] [instance: 76a0be6d-f533-4d2e-8ac5-28c894a1d4d3] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:32:50.092352 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7acb1c27-7e33-4966-830c-bf5d6f1bd7d2 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:50.092871 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7acb1c27-7e33-4966-830c-bf5d6f1bd7d2 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:50.093311 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7acb1c27-7e33-4966-830c-bf5d6f1bd7d2 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:50.093998 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7acb1c27-7e33-4966-830c-bf5d6f1bd7d2 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:50.094454 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7acb1c27-7e33-4966-830c-bf5d6f1bd7d2 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:50.094881 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7acb1c27-7e33-4966-830c-bf5d6f1bd7d2 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:50.116354 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-b249fd33-06da-4424-9eb2-a97945e150f4 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:32:50.117052 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-b249fd33-06da-4424-9eb2-a97945e150f4 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:32:50.123383 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b249fd33-06da-4424-9eb2-a97945e150f4 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:50.131837 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b249fd33-06da-4424-9eb2-a97945e150f4 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:50.131837 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b249fd33-06da-4424-9eb2-a97945e150f4 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:50.131837 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b249fd33-06da-4424-9eb2-a97945e150f4 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:50.131837 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b249fd33-06da-4424-9eb2-a97945e150f4 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:50.132233 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b249fd33-06da-4424-9eb2-a97945e150f4 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:50.132313 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7acb1c27-7e33-4966-830c-bf5d6f1bd7d2 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:50.132313 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7acb1c27-7e33-4966-830c-bf5d6f1bd7d2 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:50.132313 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7acb1c27-7e33-4966-830c-bf5d6f1bd7d2 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:50.132313 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.objects.instance [None req-7acb1c27-7e33-4966-830c-bf5d6f1bd7d2 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lazy-loading 'fault' on Instance uuid 76a0be6d-f533-4d2e-8ac5-28c894a1d4d3 {{(pid=121025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:32:50.171646 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-7acb1c27-7e33-4966-830c-bf5d6f1bd7d2 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e944928454456cabf55a6871dd9cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c95fae9a51415b9245125f5faedb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:32:50.178813 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-7acb1c27-7e33-4966-830c-bf5d6f1bd7d2 tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] 10.222.0.20 "GET /compute/v2.1/servers/76a0be6d-f533-4d2e-8ac5-28c894a1d4d3" status: 200 len: 1308 microversion: 2.1 time: 0.098120 Aug 31 01:32:50.179387 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 487/956] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:32:50 2022] GET /compute/v2.1/servers/76a0be6d-f533-4d2e-8ac5-28c894a1d4d3 => generated 1308 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:32:50.267365 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-b249fd33-06da-4424-9eb2-a97945e150f4 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:32:50.275671 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-b249fd33-06da-4424-9eb2-a97945e150f4 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1444 microversion: 2.1 time: 0.163196 Aug 31 01:32:50.276246 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 470/957] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:32:50 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1444 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:32:50.295977 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-a4238608-0ddf-4e1b-bbe9-299f587da342 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:32:50.296583 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-a4238608-0ddf-4e1b-bbe9-299f587da342 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:32:50.302494 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a4238608-0ddf-4e1b-bbe9-299f587da342 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:50.302977 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a4238608-0ddf-4e1b-bbe9-299f587da342 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:50.303407 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a4238608-0ddf-4e1b-bbe9-299f587da342 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:50.304095 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a4238608-0ddf-4e1b-bbe9-299f587da342 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:50.304544 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a4238608-0ddf-4e1b-bbe9-299f587da342 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:50.305005 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a4238608-0ddf-4e1b-bbe9-299f587da342 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:50.433652 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-a4238608-0ddf-4e1b-bbe9-299f587da342 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:32:50.441835 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-a4238608-0ddf-4e1b-bbe9-299f587da342 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1444 microversion: 2.1 time: 0.149150 Aug 31 01:32:50.442399 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 488/958] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:32:50 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1444 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:32:51.199797 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-cd3e2de1-84da-4440-819e-b1b3ba91b46a tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:32:51.200451 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-cd3e2de1-84da-4440-819e-b1b3ba91b46a tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] [instance: 76a0be6d-f533-4d2e-8ac5-28c894a1d4d3] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:32:51.208060 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cd3e2de1-84da-4440-819e-b1b3ba91b46a tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:51.209068 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cd3e2de1-84da-4440-819e-b1b3ba91b46a tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:51.209519 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cd3e2de1-84da-4440-819e-b1b3ba91b46a tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:51.210233 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cd3e2de1-84da-4440-819e-b1b3ba91b46a tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:51.210681 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cd3e2de1-84da-4440-819e-b1b3ba91b46a tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:51.211608 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cd3e2de1-84da-4440-819e-b1b3ba91b46a tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:51.226939 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.wsgi [None req-cd3e2de1-84da-4440-819e-b1b3ba91b46a tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] HTTP exception thrown: Instance 76a0be6d-f533-4d2e-8ac5-28c894a1d4d3 could not be found. Aug 31 01:32:51.228680 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-cd3e2de1-84da-4440-819e-b1b3ba91b46a tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Request method failure captured: Aug 31 01:32:51.228680 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: request: GET /compute/v2.1/servers/76a0be6d-f533-4d2e-8ac5-28c894a1d4d3 HTTP/1.1 Aug 31 01:32:51.228680 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept: application/json Aug 31 01:32:51.228680 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept-Encoding: identity Aug 31 01:32:51.228680 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Connection: close Aug 31 01:32:51.228680 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Length: 0 Aug 31 01:32:51.228680 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Type: application/json Aug 31 01:32:51.228680 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Host: 10.222.0.20 Aug 31 01:32:51.228680 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Openstack-System-Scope: None Aug 31 01:32:51.228680 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: User-Agent: python-urllib3/1.26.12 Aug 31 01:32:51.228680 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Auth-Token: gAAAAABjDrnPrunB16wtuSvIYyNo7XpfwqVAkDD2o-_hnyewTk3iHQV1Shz521eUJDN4gW0IeUHD9JZuOzFWp6ceA07H7Hb4p5FQHzaua_mMqR8wNUt0wATROYYO20zOlMxXXTcFJS1YouZ1lXMQl3q6Vg9IdYYhMSwOidGjZpPdWDQRg89XK90 Aug 31 01:32:51.228680 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Id: None Aug 31 01:32:51.228680 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Name: None Aug 31 01:32:51.228680 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Identity-Status: Confirmed Aug 31 01:32:51.228680 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Is-Admin-Project: True Aug 31 01:32:51.228680 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Id: default Aug 31 01:32:51.228680 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Name: Default Aug 31 01:32:51.228680 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Id: 29c95fae9a51415b9245125f5faedb37 Aug 31 01:32:51.228680 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2011634263 Aug 31 01:32:51.228680 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Role: member,reader Aug 31 01:32:51.228680 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Roles: member,reader Aug 31 01:32:51.230252 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/29c95fae9a51415b9245125f5faedb37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_29c95fae9a51415b9245125f5faedb37", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/29c95fae9a51415b9245125f5faedb37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/29c95fae9a51415b9245125f5faedb37"}]}] Aug 31 01:32:51.230252 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant: tempest-VolumesSnapshotTestJSON-2011634263 Aug 31 01:32:51.230252 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Id: 29c95fae9a51415b9245125f5faedb37 Aug 31 01:32:51.230252 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2011634263 Aug 31 01:32:51.230252 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User: tempest-VolumesSnapshotTestJSON-2011634263-project Aug 31 01:32:51.230252 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Id: default Aug 31 01:32:51.230252 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Name: Default Aug 31 01:32:51.230252 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Id: f3e944928454456cabf55a6871dd9cf3 Aug 31 01:32:51.230252 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Name: tempest-VolumesSnapshotTestJSON-2011634263-project Aug 31 01:32:51.230252 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: method: > Aug 31 01:32:51.230252 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: exception: Instance 76a0be6d-f533-4d2e-8ac5-28c894a1d4d3 could not be found. Aug 31 01:32:51.230252 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: action_args: {'id': '76a0be6d-f533-4d2e-8ac5-28c894a1d4d3'} Aug 31 01:32:51.231072 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:32:51.231072 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:32:51.231072 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:32:51.231072 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:32:51.231072 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:32:51.231072 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:32:51.231072 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:32:51.231072 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:32:51.231072 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:32:51.231072 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:32:51.231072 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76a0be6d-f533-4d2e-8ac5-28c894a1d4d3 could not be found. Aug 31 01:32:51.231072 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:32:51.231072 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:32:51.231072 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:32:51.231072 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:32:51.231072 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:32:51.231072 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:32:51.231072 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:32:51.231072 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:32:51.231072 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:32:51.232406 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:32:51.232406 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:32:51.232406 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:32:51.232406 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:32:51.232406 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:32:51.232406 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:32:51.232406 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:32:51.232406 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76a0be6d-f533-4d2e-8ac5-28c894a1d4d3 could not be found. Aug 31 01:32:51.232406 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:32:51.232406 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:32:51.232406 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:32:51.232406 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:32:51.232406 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:32:51.232406 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:32:51.232406 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:32:51.232406 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:32:51.232406 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76a0be6d-f533-4d2e-8ac5-28c894a1d4d3 could not be found. Aug 31 01:32:51.232406 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:32:51.237207 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-cd3e2de1-84da-4440-819e-b1b3ba91b46a tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] Returning 404 to user: Instance 76a0be6d-f533-4d2e-8ac5-28c894a1d4d3 could not be found. {{(pid=121026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:32:51.237207 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-cd3e2de1-84da-4440-819e-b1b3ba91b46a tempest-VolumesSnapshotTestJSON-2011634263 tempest-VolumesSnapshotTestJSON-2011634263-project] 10.222.0.20 "GET /compute/v2.1/servers/76a0be6d-f533-4d2e-8ac5-28c894a1d4d3" status: 404 len: 111 microversion: 2.1 time: 0.034702 Aug 31 01:32:51.237207 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 471/959] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:32:51 2022] GET /compute/v2.1/servers/76a0be6d-f533-4d2e-8ac5-28c894a1d4d3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:32:52.580203 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-d8cdda1c-f72f-4609-af23-c7b35b58f60d req-23aae0c9-e90f-497c-bb93-082f8d247ee3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a8fe146-0b7b-4588-b312-2a525c4ca249", "tag": "51e05401-efe1-4123-a876-e27cdccec893"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:32:52.591181 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-d8cdda1c-f72f-4609-af23-c7b35b58f60d req-23aae0c9-e90f-497c-bb93-082f8d247ee3 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:32:52.594695 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-d8cdda1c-f72f-4609-af23-c7b35b58f60d req-23aae0c9-e90f-497c-bb93-082f8d247ee3 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:32:52.594695 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-d8cdda1c-f72f-4609-af23-c7b35b58f60d req-23aae0c9-e90f-497c-bb93-082f8d247ee3 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:32:52.605597 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-d8cdda1c-f72f-4609-af23-c7b35b58f60d req-23aae0c9-e90f-497c-bb93-082f8d247ee3 service nova] Creating event network-changed:51e05401-efe1-4123-a876-e27cdccec893 for instance 9a8fe146-0b7b-4588-b312-2a525c4ca249 on hv-cinder-85528 Aug 31 01:32:52.610866 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-d8cdda1c-f72f-4609-af23-c7b35b58f60d req-23aae0c9-e90f-497c-bb93-082f8d247ee3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034469 Aug 31 01:32:52.613271 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 489/960] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:33:28.984286 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:33:28.985051 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:33:29.156359 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-88fd3e1e-bdc4-4452-af05-bccf388b4e07 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Action: 'create', calling method: .version_select at 0x7f1fe1585ca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1559894197", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMy3OM0dqphp/dcFA323bkQUJNMJEZYHhBoz03yw4CHsgo7IrOp2wiYZ14/pEoLE9V8vN2BlNjzUbx3hMKOmpb3fAR0IkdNopcKur46FwOtiGrJl5tPBzhRtlu0e6Ddpug=="}} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:33:29.172116 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.quota [None req-88fd3e1e-bdc4-4452-af05-bccf388b4e07 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Getting quotas for project 8a6177d84e534b358b475672f474f6df. Resources: {'key_pairs'} {{(pid=121026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 01:33:29.175924 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.quota [None req-88fd3e1e-bdc4-4452-af05-bccf388b4e07 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Getting quotas for user af97536937fb405198e1474fc134b493 and project 8a6177d84e534b358b475672f474f6df. Resources: {'key_pairs'} {{(pid=121026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 01:33:29.260527 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-88fd3e1e-bdc4-4452-af05-bccf388b4e07 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.281007 Aug 31 01:33:29.261092 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 472/961] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Aug 31 01:33:28 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:33:46.149545 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-223e6ae9-f5cc-4861-a8bc-19e8a3a6ea6c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-951050794", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1559894197", "security_groups": [{"name": "tempest-secgroup-smoke-1481444852"}], "block_device_mapping_v2": [{"uuid": "55444754-ac90-4c8c-b1b5-7f3ae741c833", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1c20fdf4-c01e-4a42-bd98-933028a4956d"}]}} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:33:46.160058 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:33:46.160740 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell1:SELECT=70 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:33:46.265562 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.network.neutron [None req-223e6ae9-f5cc-4861-a8bc-19e8a3a6ea6c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] validate_networks() for [('1c20fdf4-c01e-4a42-bd98-933028a4956d', None, None, None, None, None)] {{(pid=121025) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 01:33:46.712363 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-223e6ae9-f5cc-4861-a8bc-19e8a3a6ea6c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Flavor limits 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 01:33:46.712823 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-223e6ae9-f5cc-4861-a8bc-19e8a3a6ea6c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Image limits 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 01:33:46.713297 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-223e6ae9-f5cc-4861-a8bc-19e8a3a6ea6c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Flavor pref 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 01:33:46.713702 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-223e6ae9-f5cc-4861-a8bc-19e8a3a6ea6c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Image pref 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 01:33:46.714108 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-223e6ae9-f5cc-4861-a8bc-19e8a3a6ea6c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 01:33:46.722778 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-223e6ae9-f5cc-4861-a8bc-19e8a3a6ea6c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:33:46.723257 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-223e6ae9-f5cc-4861-a8bc-19e8a3a6ea6c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:33:46.723685 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-223e6ae9-f5cc-4861-a8bc-19e8a3a6ea6c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:33:46.724407 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-223e6ae9-f5cc-4861-a8bc-19e8a3a6ea6c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:33:46.724897 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-223e6ae9-f5cc-4861-a8bc-19e8a3a6ea6c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:33:46.725319 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-223e6ae9-f5cc-4861-a8bc-19e8a3a6ea6c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:33:46.742023 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.quota [None req-223e6ae9-f5cc-4861-a8bc-19e8a3a6ea6c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Getting quotas for project 8a6177d84e534b358b475672f474f6df. Resources: {'instances', 'cores', 'ram'} {{(pid=121025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 01:33:46.746328 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.quota [None req-223e6ae9-f5cc-4861-a8bc-19e8a3a6ea6c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Getting quotas for user af97536937fb405198e1474fc134b493 and project 8a6177d84e534b358b475672f474f6df. Resources: {'instances', 'cores', 'ram'} {{(pid=121025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 01:33:46.801310 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-223e6ae9-f5cc-4861-a8bc-19e8a3a6ea6c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Going to run 1 instances... {{(pid=121025) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 01:33:46.803505 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-223e6ae9-f5cc-4861-a8bc-19e8a3a6ea6c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: e78060b8-25a5-43e3-8deb-d59bd2b3bae6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='55444754-ac90-4c8c-b1b5-7f3ae741c833',volume_size=None,volume_type=None)] {{(pid=121025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 01:33:47.254168 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-223e6ae9-f5cc-4861-a8bc-19e8a3a6ea6c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.108736 Aug 31 01:33:47.254806 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 490/962] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 31 01:33:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 1110 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 01:33:47.263230 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell0:SELECT=4 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:33:47.264038 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:33:47.268085 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-1c4234c2-f8f0-48ee-a1f5-91bb6c967991 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:33:47.268698 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-1c4234c2-f8f0-48ee-a1f5-91bb6c967991 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: e78060b8-25a5-43e3-8deb-d59bd2b3bae6] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:33:47.323410 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-1c4234c2-f8f0-48ee-a1f5-91bb6c967991 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:33:47.332218 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-1c4234c2-f8f0-48ee-a1f5-91bb6c967991 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6" status: 200 len: 1094 microversion: 2.1 time: 0.070450 Aug 31 01:33:47.333032 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 473/963] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:33:47 2022] GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:33:48.353642 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-0a733b34-0586-4011-b44a-f14b6da3c9f5 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:33:48.354816 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-0a733b34-0586-4011-b44a-f14b6da3c9f5 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: e78060b8-25a5-43e3-8deb-d59bd2b3bae6] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:33:48.361734 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0a733b34-0586-4011-b44a-f14b6da3c9f5 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:33:48.362216 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0a733b34-0586-4011-b44a-f14b6da3c9f5 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:33:48.362645 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0a733b34-0586-4011-b44a-f14b6da3c9f5 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:33:48.363322 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0a733b34-0586-4011-b44a-f14b6da3c9f5 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:33:48.363767 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0a733b34-0586-4011-b44a-f14b6da3c9f5 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:33:48.364209 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0a733b34-0586-4011-b44a-f14b6da3c9f5 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:33:48.427701 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-0a733b34-0586-4011-b44a-f14b6da3c9f5 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:33:48.435524 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-0a733b34-0586-4011-b44a-f14b6da3c9f5 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6" status: 200 len: 1144 microversion: 2.1 time: 0.086261 Aug 31 01:33:48.436074 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 491/964] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:33:48 2022] GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6 => generated 1144 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:33:49.456694 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-17b5f671-b2d5-48b9-8b6f-8e16d461eed8 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:33:49.459797 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-17b5f671-b2d5-48b9-8b6f-8e16d461eed8 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: e78060b8-25a5-43e3-8deb-d59bd2b3bae6] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:33:49.465366 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-17b5f671-b2d5-48b9-8b6f-8e16d461eed8 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:33:49.466020 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-17b5f671-b2d5-48b9-8b6f-8e16d461eed8 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:33:49.466465 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-17b5f671-b2d5-48b9-8b6f-8e16d461eed8 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:33:49.467585 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-17b5f671-b2d5-48b9-8b6f-8e16d461eed8 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:33:49.467585 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-17b5f671-b2d5-48b9-8b6f-8e16d461eed8 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:33:49.468021 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-17b5f671-b2d5-48b9-8b6f-8e16d461eed8 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:33:49.530416 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-17b5f671-b2d5-48b9-8b6f-8e16d461eed8 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:33:49.538256 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-17b5f671-b2d5-48b9-8b6f-8e16d461eed8 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6" status: 200 len: 1210 microversion: 2.1 time: 0.085855 Aug 31 01:33:49.538820 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 474/965] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:33:49 2022] GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6 => generated 1210 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:33:50.560069 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-74566c1e-cf5e-4a08-9f36-5ba01f8938b5 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:33:50.560759 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-74566c1e-cf5e-4a08-9f36-5ba01f8938b5 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: e78060b8-25a5-43e3-8deb-d59bd2b3bae6] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:33:50.567994 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-74566c1e-cf5e-4a08-9f36-5ba01f8938b5 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:33:50.568488 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-74566c1e-cf5e-4a08-9f36-5ba01f8938b5 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:33:50.568952 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-74566c1e-cf5e-4a08-9f36-5ba01f8938b5 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:33:50.569652 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-74566c1e-cf5e-4a08-9f36-5ba01f8938b5 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:33:50.570099 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-74566c1e-cf5e-4a08-9f36-5ba01f8938b5 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:33:50.570703 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-74566c1e-cf5e-4a08-9f36-5ba01f8938b5 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:33:50.719512 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-74566c1e-cf5e-4a08-9f36-5ba01f8938b5 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:33:50.727460 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-74566c1e-cf5e-4a08-9f36-5ba01f8938b5 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6" status: 200 len: 1278 microversion: 2.1 time: 0.171824 Aug 31 01:33:50.728381 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 492/966] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:33:50 2022] GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6 => generated 1278 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:33:51.063354 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [req-ae6d87b6-4d53-465c-93df-e95d96874a6f req-cb7d04a9-841b-49ab-b45e-22f947b7e35f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e78060b8-25a5-43e3-8deb-d59bd2b3bae6", "tag": "4278caa6-ff39-4080-94a7-80095f21e419"}]} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:33:51.073809 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-ae6d87b6-4d53-465c-93df-e95d96874a6f req-cb7d04a9-841b-49ab-b45e-22f947b7e35f service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:33:51.076637 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-ae6d87b6-4d53-465c-93df-e95d96874a6f req-cb7d04a9-841b-49ab-b45e-22f947b7e35f service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:33:51.076637 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-ae6d87b6-4d53-465c-93df-e95d96874a6f req-cb7d04a9-841b-49ab-b45e-22f947b7e35f service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:33:51.088295 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.compute.server_external_events [req-ae6d87b6-4d53-465c-93df-e95d96874a6f req-cb7d04a9-841b-49ab-b45e-22f947b7e35f service nova] Creating event network-changed:4278caa6-ff39-4080-94a7-80095f21e419 for instance e78060b8-25a5-43e3-8deb-d59bd2b3bae6 on hv-cinder-85528 Aug 31 01:33:51.093979 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [req-ae6d87b6-4d53-465c-93df-e95d96874a6f req-cb7d04a9-841b-49ab-b45e-22f947b7e35f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090529 Aug 31 01:33:51.094567 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 475/967] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:33:51.749477 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-0336e1fd-fcca-458c-81f2-f31c95c7cb11 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:33:51.750081 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-0336e1fd-fcca-458c-81f2-f31c95c7cb11 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: e78060b8-25a5-43e3-8deb-d59bd2b3bae6] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:33:51.756538 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0336e1fd-fcca-458c-81f2-f31c95c7cb11 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:33:51.757049 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0336e1fd-fcca-458c-81f2-f31c95c7cb11 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:33:51.757476 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0336e1fd-fcca-458c-81f2-f31c95c7cb11 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:33:51.758162 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0336e1fd-fcca-458c-81f2-f31c95c7cb11 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:33:51.758606 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0336e1fd-fcca-458c-81f2-f31c95c7cb11 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:33:51.759020 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0336e1fd-fcca-458c-81f2-f31c95c7cb11 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:33:51.891119 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-0336e1fd-fcca-458c-81f2-f31c95c7cb11 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:33:51.905697 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-0336e1fd-fcca-458c-81f2-f31c95c7cb11 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6" status: 200 len: 1266 microversion: 2.1 time: 0.160322 Aug 31 01:33:51.906791 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 493/968] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:33:51 2022] GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:33:52.934834 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-d2a070f9-835c-4537-a8bd-cf42a3ec89c6 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:33:52.935536 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-d2a070f9-835c-4537-a8bd-cf42a3ec89c6 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: e78060b8-25a5-43e3-8deb-d59bd2b3bae6] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:33:52.941702 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d2a070f9-835c-4537-a8bd-cf42a3ec89c6 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:33:52.942185 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d2a070f9-835c-4537-a8bd-cf42a3ec89c6 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:33:52.942621 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d2a070f9-835c-4537-a8bd-cf42a3ec89c6 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:33:52.943307 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d2a070f9-835c-4537-a8bd-cf42a3ec89c6 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:33:52.943763 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d2a070f9-835c-4537-a8bd-cf42a3ec89c6 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:33:52.944188 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d2a070f9-835c-4537-a8bd-cf42a3ec89c6 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:33:53.073295 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-d2a070f9-835c-4537-a8bd-cf42a3ec89c6 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:33:53.081693 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-d2a070f9-835c-4537-a8bd-cf42a3ec89c6 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6" status: 200 len: 1266 microversion: 2.1 time: 0.151654 Aug 31 01:33:53.082255 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 476/969] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:33:52 2022] GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:33:54.102753 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-40d4a98d-1ae8-44ce-8bad-0cadd4cb1da7 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:33:54.103358 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-40d4a98d-1ae8-44ce-8bad-0cadd4cb1da7 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: e78060b8-25a5-43e3-8deb-d59bd2b3bae6] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:33:54.109683 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-40d4a98d-1ae8-44ce-8bad-0cadd4cb1da7 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:33:54.110160 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-40d4a98d-1ae8-44ce-8bad-0cadd4cb1da7 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:33:54.110589 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-40d4a98d-1ae8-44ce-8bad-0cadd4cb1da7 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:33:54.111294 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-40d4a98d-1ae8-44ce-8bad-0cadd4cb1da7 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:33:54.111738 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-40d4a98d-1ae8-44ce-8bad-0cadd4cb1da7 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:33:54.112153 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-40d4a98d-1ae8-44ce-8bad-0cadd4cb1da7 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:33:54.243041 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-40d4a98d-1ae8-44ce-8bad-0cadd4cb1da7 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:33:54.251095 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-40d4a98d-1ae8-44ce-8bad-0cadd4cb1da7 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6" status: 200 len: 1266 microversion: 2.1 time: 0.152132 Aug 31 01:33:54.251659 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 494/970] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:33:54 2022] GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:33:55.272449 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-204325b4-5abf-4fa1-9e23-1e5559c018b7 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:33:55.273086 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-204325b4-5abf-4fa1-9e23-1e5559c018b7 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: e78060b8-25a5-43e3-8deb-d59bd2b3bae6] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:33:55.280197 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-204325b4-5abf-4fa1-9e23-1e5559c018b7 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:33:55.280677 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-204325b4-5abf-4fa1-9e23-1e5559c018b7 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:33:55.281139 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-204325b4-5abf-4fa1-9e23-1e5559c018b7 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:33:55.281824 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-204325b4-5abf-4fa1-9e23-1e5559c018b7 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:33:55.282275 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-204325b4-5abf-4fa1-9e23-1e5559c018b7 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:33:55.282697 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-204325b4-5abf-4fa1-9e23-1e5559c018b7 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:33:55.411125 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-204325b4-5abf-4fa1-9e23-1e5559c018b7 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:33:55.418750 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-204325b4-5abf-4fa1-9e23-1e5559c018b7 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6" status: 200 len: 1266 microversion: 2.1 time: 0.150214 Aug 31 01:33:55.419311 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 477/971] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:33:55 2022] GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:33:56.439684 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-474f55a5-f314-4728-804c-04a3adfab2f5 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:33:56.440354 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-474f55a5-f314-4728-804c-04a3adfab2f5 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: e78060b8-25a5-43e3-8deb-d59bd2b3bae6] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:33:56.446653 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-474f55a5-f314-4728-804c-04a3adfab2f5 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:33:56.447133 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-474f55a5-f314-4728-804c-04a3adfab2f5 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:33:56.447560 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-474f55a5-f314-4728-804c-04a3adfab2f5 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:33:56.448239 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-474f55a5-f314-4728-804c-04a3adfab2f5 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:33:56.448691 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-474f55a5-f314-4728-804c-04a3adfab2f5 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:33:56.449126 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-474f55a5-f314-4728-804c-04a3adfab2f5 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:33:56.580187 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-474f55a5-f314-4728-804c-04a3adfab2f5 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:33:56.588147 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-474f55a5-f314-4728-804c-04a3adfab2f5 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6" status: 200 len: 1266 microversion: 2.1 time: 0.152353 Aug 31 01:33:56.588716 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 495/972] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:33:56 2022] GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:33:57.609251 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-cde701de-b121-428c-b61d-942bf9f96a63 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:33:57.609856 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-cde701de-b121-428c-b61d-942bf9f96a63 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: e78060b8-25a5-43e3-8deb-d59bd2b3bae6] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:33:57.612320 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell0:SELECT=2 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:33:57.617310 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cde701de-b121-428c-b61d-942bf9f96a63 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:33:57.617826 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cde701de-b121-428c-b61d-942bf9f96a63 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:33:57.618258 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cde701de-b121-428c-b61d-942bf9f96a63 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:33:57.618946 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cde701de-b121-428c-b61d-942bf9f96a63 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:33:57.619400 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cde701de-b121-428c-b61d-942bf9f96a63 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:33:57.619867 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-cde701de-b121-428c-b61d-942bf9f96a63 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:33:57.749544 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-cde701de-b121-428c-b61d-942bf9f96a63 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:33:57.757076 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-cde701de-b121-428c-b61d-942bf9f96a63 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6" status: 200 len: 1266 microversion: 2.1 time: 0.152294 Aug 31 01:33:57.757641 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 478/973] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:33:57 2022] GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:33:58.777389 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-7b0e15c2-a391-4bb8-b507-a61ace573d5d tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:33:58.778026 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-7b0e15c2-a391-4bb8-b507-a61ace573d5d tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: e78060b8-25a5-43e3-8deb-d59bd2b3bae6] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:33:58.779877 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell0:SELECT=2 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:33:58.780521 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell0:SELECT=6 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:33:58.786038 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7b0e15c2-a391-4bb8-b507-a61ace573d5d tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:33:58.786517 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7b0e15c2-a391-4bb8-b507-a61ace573d5d tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:33:58.786946 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7b0e15c2-a391-4bb8-b507-a61ace573d5d tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:33:58.787630 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7b0e15c2-a391-4bb8-b507-a61ace573d5d tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:33:58.788083 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7b0e15c2-a391-4bb8-b507-a61ace573d5d tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:33:58.788496 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7b0e15c2-a391-4bb8-b507-a61ace573d5d tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:33:58.922155 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-7b0e15c2-a391-4bb8-b507-a61ace573d5d tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:33:58.929664 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-7b0e15c2-a391-4bb8-b507-a61ace573d5d tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6" status: 200 len: 1266 microversion: 2.1 time: 0.156085 Aug 31 01:33:58.931440 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 496/974] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:33:58 2022] GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:33:59.950848 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-ae527c07-6e5a-4b54-b6ed-0b8ff9e57fd3 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:33:59.952137 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-ae527c07-6e5a-4b54-b6ed-0b8ff9e57fd3 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: e78060b8-25a5-43e3-8deb-d59bd2b3bae6] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:33:59.959048 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ae527c07-6e5a-4b54-b6ed-0b8ff9e57fd3 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:33:59.959556 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ae527c07-6e5a-4b54-b6ed-0b8ff9e57fd3 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:33:59.959996 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ae527c07-6e5a-4b54-b6ed-0b8ff9e57fd3 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:33:59.960687 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ae527c07-6e5a-4b54-b6ed-0b8ff9e57fd3 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:33:59.961174 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ae527c07-6e5a-4b54-b6ed-0b8ff9e57fd3 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:33:59.961596 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ae527c07-6e5a-4b54-b6ed-0b8ff9e57fd3 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:34:00.094071 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-ae527c07-6e5a-4b54-b6ed-0b8ff9e57fd3 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:34:00.101687 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-ae527c07-6e5a-4b54-b6ed-0b8ff9e57fd3 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6" status: 200 len: 1266 microversion: 2.1 time: 0.154889 Aug 31 01:34:00.102260 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 479/975] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:33:59 2022] GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:34:00.794332 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-2da24942-6215-438b-a47b-f3c5967c67f9 req-d67f7764-71c2-4a22-9f0a-be7e9dd68b1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e78060b8-25a5-43e3-8deb-d59bd2b3bae6", "name": "network-vif-plugged", "status": "completed", "tag": "4278caa6-ff39-4080-94a7-80095f21e419"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:34:00.804261 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-2da24942-6215-438b-a47b-f3c5967c67f9 req-d67f7764-71c2-4a22-9f0a-be7e9dd68b1e service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:34:00.804759 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-2da24942-6215-438b-a47b-f3c5967c67f9 req-d67f7764-71c2-4a22-9f0a-be7e9dd68b1e service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:34:00.805192 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-2da24942-6215-438b-a47b-f3c5967c67f9 req-d67f7764-71c2-4a22-9f0a-be7e9dd68b1e service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:34:00.815976 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-2da24942-6215-438b-a47b-f3c5967c67f9 req-d67f7764-71c2-4a22-9f0a-be7e9dd68b1e service nova] Creating event network-vif-plugged:4278caa6-ff39-4080-94a7-80095f21e419 for instance e78060b8-25a5-43e3-8deb-d59bd2b3bae6 on hv-cinder-85528 Aug 31 01:34:00.820962 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-2da24942-6215-438b-a47b-f3c5967c67f9 req-d67f7764-71c2-4a22-9f0a-be7e9dd68b1e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087494 Aug 31 01:34:00.821745 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 497/976] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:34:01.121256 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-1695b794-4a2b-4d8a-8d8e-bb22bc3d7cb2 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:34:01.121905 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-1695b794-4a2b-4d8a-8d8e-bb22bc3d7cb2 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: e78060b8-25a5-43e3-8deb-d59bd2b3bae6] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:34:01.128341 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1695b794-4a2b-4d8a-8d8e-bb22bc3d7cb2 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:34:01.128861 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1695b794-4a2b-4d8a-8d8e-bb22bc3d7cb2 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:34:01.129297 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1695b794-4a2b-4d8a-8d8e-bb22bc3d7cb2 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:34:01.129990 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1695b794-4a2b-4d8a-8d8e-bb22bc3d7cb2 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:34:01.130445 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1695b794-4a2b-4d8a-8d8e-bb22bc3d7cb2 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:34:01.130869 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1695b794-4a2b-4d8a-8d8e-bb22bc3d7cb2 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:34:01.268831 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-1695b794-4a2b-4d8a-8d8e-bb22bc3d7cb2 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:34:01.276667 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-1695b794-4a2b-4d8a-8d8e-bb22bc3d7cb2 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6" status: 200 len: 1266 microversion: 2.1 time: 0.159250 Aug 31 01:34:01.277275 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 480/977] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:34:01 2022] GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:34:02.303903 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-870be561-e527-417e-b97c-0c0784707fcb tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:34:02.305215 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-870be561-e527-417e-b97c-0c0784707fcb tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: e78060b8-25a5-43e3-8deb-d59bd2b3bae6] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:34:02.315709 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-870be561-e527-417e-b97c-0c0784707fcb tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:34:02.316583 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-870be561-e527-417e-b97c-0c0784707fcb tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:34:02.317183 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-870be561-e527-417e-b97c-0c0784707fcb tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:34:02.318407 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-870be561-e527-417e-b97c-0c0784707fcb tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:34:02.319230 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-870be561-e527-417e-b97c-0c0784707fcb tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:34:02.319991 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-870be561-e527-417e-b97c-0c0784707fcb tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:34:02.460591 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-870be561-e527-417e-b97c-0c0784707fcb tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:34:02.468683 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-870be561-e527-417e-b97c-0c0784707fcb tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6" status: 200 len: 1266 microversion: 2.1 time: 0.173589 Aug 31 01:34:02.469268 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 498/978] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:34:02 2022] GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:34:03.489413 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-c584da38-e883-4738-af0b-41e4e8ec3e35 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:34:03.496070 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-c584da38-e883-4738-af0b-41e4e8ec3e35 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: e78060b8-25a5-43e3-8deb-d59bd2b3bae6] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:34:03.496070 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c584da38-e883-4738-af0b-41e4e8ec3e35 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:34:03.496765 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c584da38-e883-4738-af0b-41e4e8ec3e35 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:34:03.497202 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c584da38-e883-4738-af0b-41e4e8ec3e35 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:34:03.497879 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c584da38-e883-4738-af0b-41e4e8ec3e35 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:34:03.498325 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c584da38-e883-4738-af0b-41e4e8ec3e35 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:34:03.498742 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-c584da38-e883-4738-af0b-41e4e8ec3e35 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:34:03.633370 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-c584da38-e883-4738-af0b-41e4e8ec3e35 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:34:03.640584 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-c584da38-e883-4738-af0b-41e4e8ec3e35 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6" status: 200 len: 1452 microversion: 2.1 time: 0.155104 Aug 31 01:34:03.641171 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 481/979] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:34:03 2022] GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6 => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:34:03.660806 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-67d2083d-0de5-49bf-b4f9-8098d3593ec4 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:34:03.663128 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-67d2083d-0de5-49bf-b4f9-8098d3593ec4 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: e78060b8-25a5-43e3-8deb-d59bd2b3bae6] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:34:03.667822 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-67d2083d-0de5-49bf-b4f9-8098d3593ec4 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:34:03.668305 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-67d2083d-0de5-49bf-b4f9-8098d3593ec4 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:34:03.668770 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-67d2083d-0de5-49bf-b4f9-8098d3593ec4 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:34:03.669484 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-67d2083d-0de5-49bf-b4f9-8098d3593ec4 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:34:03.669929 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-67d2083d-0de5-49bf-b4f9-8098d3593ec4 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:34:03.670352 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-67d2083d-0de5-49bf-b4f9-8098d3593ec4 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:34:03.803219 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-67d2083d-0de5-49bf-b4f9-8098d3593ec4 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:34:03.811490 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-67d2083d-0de5-49bf-b4f9-8098d3593ec4 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6" status: 200 len: 1452 microversion: 2.1 time: 0.154493 Aug 31 01:34:03.812067 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 499/980] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:34:03 2022] GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6 => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:34:05.791075 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [req-2815f084-4a3d-4071-b6ed-644d302c318b req-465ed326-21b8-43cd-8f90-e0bf5fcf645f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e78060b8-25a5-43e3-8deb-d59bd2b3bae6", "tag": "4278caa6-ff39-4080-94a7-80095f21e419"}]} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:34:05.801382 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-2815f084-4a3d-4071-b6ed-644d302c318b req-465ed326-21b8-43cd-8f90-e0bf5fcf645f service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:34:05.801874 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-2815f084-4a3d-4071-b6ed-644d302c318b req-465ed326-21b8-43cd-8f90-e0bf5fcf645f service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:34:05.802308 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-2815f084-4a3d-4071-b6ed-644d302c318b req-465ed326-21b8-43cd-8f90-e0bf5fcf645f service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:34:05.814680 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.compute.server_external_events [req-2815f084-4a3d-4071-b6ed-644d302c318b req-465ed326-21b8-43cd-8f90-e0bf5fcf645f service nova] Creating event network-changed:4278caa6-ff39-4080-94a7-80095f21e419 for instance e78060b8-25a5-43e3-8deb-d59bd2b3bae6 on hv-cinder-85528 Aug 31 01:34:05.820098 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [req-2815f084-4a3d-4071-b6ed-644d302c318b req-465ed326-21b8-43cd-8f90-e0bf5fcf645f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086845 Aug 31 01:34:05.820716 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 482/981] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:34:47.858831 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-5a422a64-a932-4331-a4b8-9bba12f2a99a tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:34:47.859474 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-5a422a64-a932-4331-a4b8-9bba12f2a99a tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:34:47.861726 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:34:47.862379 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell1:SELECT=52 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:34:47.867569 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5a422a64-a932-4331-a4b8-9bba12f2a99a tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:34:47.874547 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5a422a64-a932-4331-a4b8-9bba12f2a99a tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:34:47.874547 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5a422a64-a932-4331-a4b8-9bba12f2a99a tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:34:47.874547 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5a422a64-a932-4331-a4b8-9bba12f2a99a tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:34:47.874547 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5a422a64-a932-4331-a4b8-9bba12f2a99a tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:34:47.875025 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-5a422a64-a932-4331-a4b8-9bba12f2a99a tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:34:47.892947 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.objects.instance [None req-5a422a64-a932-4331-a4b8-9bba12f2a99a tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lazy-loading 'flavor' on Instance uuid 9a8fe146-0b7b-4588-b312-2a525c4ca249 {{(pid=121025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:34:48.255453 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-5a422a64-a932-4331-a4b8-9bba12f2a99a tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "POST /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249/action" status: 202 len: 0 microversion: 2.1 time: 0.400315 Aug 31 01:34:48.256043 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 500/982] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 31 01:34:47 2022] POST /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249/action => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 01:34:48.262893 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_api:SELECT=22 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:34:48.263723 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell1:SELECT=46 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:34:48.268551 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-f71724ea-5fca-4ccd-809f-a78fe3539aba tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:34:48.269497 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-f71724ea-5fca-4ccd-809f-a78fe3539aba tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:34:48.278054 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f71724ea-5fca-4ccd-809f-a78fe3539aba tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:34:48.278542 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f71724ea-5fca-4ccd-809f-a78fe3539aba tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:34:48.279043 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f71724ea-5fca-4ccd-809f-a78fe3539aba tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:34:48.279736 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f71724ea-5fca-4ccd-809f-a78fe3539aba tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:34:48.280188 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f71724ea-5fca-4ccd-809f-a78fe3539aba tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:34:48.280607 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f71724ea-5fca-4ccd-809f-a78fe3539aba tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:34:48.419042 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-f71724ea-5fca-4ccd-809f-a78fe3539aba tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:34:48.426844 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-f71724ea-5fca-4ccd-809f-a78fe3539aba tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1569 microversion: 2.1 time: 0.165724 Aug 31 01:34:48.427404 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 483/983] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:34:48 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:34:49.450986 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-0261300b-bc9a-42ec-b6c0-39ad72e9b42c tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:34:49.451718 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-0261300b-bc9a-42ec-b6c0-39ad72e9b42c tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:34:49.458206 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0261300b-bc9a-42ec-b6c0-39ad72e9b42c tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:34:49.463930 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0261300b-bc9a-42ec-b6c0-39ad72e9b42c tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:34:49.463930 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0261300b-bc9a-42ec-b6c0-39ad72e9b42c tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:34:49.463930 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0261300b-bc9a-42ec-b6c0-39ad72e9b42c tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:34:49.463930 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0261300b-bc9a-42ec-b6c0-39ad72e9b42c tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:34:49.464310 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0261300b-bc9a-42ec-b6c0-39ad72e9b42c tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:34:49.589101 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-0261300b-bc9a-42ec-b6c0-39ad72e9b42c tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:34:49.596787 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-0261300b-bc9a-42ec-b6c0-39ad72e9b42c tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1569 microversion: 2.1 time: 0.151172 Aug 31 01:34:49.597360 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 501/984] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:34:49 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:34:50.617994 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-f668aea6-65f5-4427-93cd-bf38a5fb1ad3 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:34:50.618599 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-f668aea6-65f5-4427-93cd-bf38a5fb1ad3 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:34:50.625351 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f668aea6-65f5-4427-93cd-bf38a5fb1ad3 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:34:50.625826 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f668aea6-65f5-4427-93cd-bf38a5fb1ad3 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:34:50.626255 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f668aea6-65f5-4427-93cd-bf38a5fb1ad3 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:34:50.626943 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f668aea6-65f5-4427-93cd-bf38a5fb1ad3 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:34:50.627387 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f668aea6-65f5-4427-93cd-bf38a5fb1ad3 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:34:50.627806 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f668aea6-65f5-4427-93cd-bf38a5fb1ad3 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:34:50.761702 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-f668aea6-65f5-4427-93cd-bf38a5fb1ad3 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:34:50.769599 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-f668aea6-65f5-4427-93cd-bf38a5fb1ad3 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1569 microversion: 2.1 time: 0.155529 Aug 31 01:34:50.770167 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 484/985] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:34:50 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:34:51.791986 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-80514c1f-755f-48e7-bf75-cff1bd7a072c tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:34:51.792596 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-80514c1f-755f-48e7-bf75-cff1bd7a072c tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:34:51.799074 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-80514c1f-755f-48e7-bf75-cff1bd7a072c tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:34:51.799547 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-80514c1f-755f-48e7-bf75-cff1bd7a072c tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:34:51.799979 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-80514c1f-755f-48e7-bf75-cff1bd7a072c tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:34:51.800665 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-80514c1f-755f-48e7-bf75-cff1bd7a072c tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:34:51.801143 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-80514c1f-755f-48e7-bf75-cff1bd7a072c tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:34:51.801563 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-80514c1f-755f-48e7-bf75-cff1bd7a072c tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:34:51.932458 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-80514c1f-755f-48e7-bf75-cff1bd7a072c tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:34:51.940132 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-80514c1f-755f-48e7-bf75-cff1bd7a072c tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1569 microversion: 2.1 time: 0.152641 Aug 31 01:34:51.940696 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 502/986] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:34:51 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:34:52.961321 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-0a5d0f2e-4f23-4c8f-ac9f-1c6160585c9b tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:34:52.961931 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-0a5d0f2e-4f23-4c8f-ac9f-1c6160585c9b tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:34:52.968275 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0a5d0f2e-4f23-4c8f-ac9f-1c6160585c9b tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:34:52.968834 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0a5d0f2e-4f23-4c8f-ac9f-1c6160585c9b tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:34:52.969276 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0a5d0f2e-4f23-4c8f-ac9f-1c6160585c9b tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:34:52.969960 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0a5d0f2e-4f23-4c8f-ac9f-1c6160585c9b tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:34:52.970410 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0a5d0f2e-4f23-4c8f-ac9f-1c6160585c9b tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:34:52.970829 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-0a5d0f2e-4f23-4c8f-ac9f-1c6160585c9b tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:34:53.101705 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-0a5d0f2e-4f23-4c8f-ac9f-1c6160585c9b tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:34:53.109888 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-0a5d0f2e-4f23-4c8f-ac9f-1c6160585c9b tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1569 microversion: 2.1 time: 0.152478 Aug 31 01:34:53.110457 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 485/987] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:34:52 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:34:54.131622 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-dfebeab2-0a35-48e4-b108-23fe35cba2ea tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:34:54.132233 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-dfebeab2-0a35-48e4-b108-23fe35cba2ea tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:34:54.138643 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-dfebeab2-0a35-48e4-b108-23fe35cba2ea tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:34:54.139129 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-dfebeab2-0a35-48e4-b108-23fe35cba2ea tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:34:54.139564 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-dfebeab2-0a35-48e4-b108-23fe35cba2ea tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:34:54.140258 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-dfebeab2-0a35-48e4-b108-23fe35cba2ea tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:34:54.140744 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-dfebeab2-0a35-48e4-b108-23fe35cba2ea tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:34:54.141178 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-dfebeab2-0a35-48e4-b108-23fe35cba2ea tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:34:54.269498 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-dfebeab2-0a35-48e4-b108-23fe35cba2ea tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:34:54.277743 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-dfebeab2-0a35-48e4-b108-23fe35cba2ea tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1569 microversion: 2.1 time: 0.150074 Aug 31 01:34:54.278309 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 503/988] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:34:54 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:34:55.299094 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-d6212ce0-060a-4527-8be7-371a7e3b16bc tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:34:55.299708 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-d6212ce0-060a-4527-8be7-371a7e3b16bc tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:34:55.306814 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d6212ce0-060a-4527-8be7-371a7e3b16bc tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:34:55.307293 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d6212ce0-060a-4527-8be7-371a7e3b16bc tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:34:55.307727 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d6212ce0-060a-4527-8be7-371a7e3b16bc tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:34:55.308413 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d6212ce0-060a-4527-8be7-371a7e3b16bc tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:34:55.308904 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d6212ce0-060a-4527-8be7-371a7e3b16bc tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:34:55.309327 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d6212ce0-060a-4527-8be7-371a7e3b16bc tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:34:55.436217 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-d6212ce0-060a-4527-8be7-371a7e3b16bc tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:34:55.443870 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-d6212ce0-060a-4527-8be7-371a7e3b16bc tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1569 microversion: 2.1 time: 0.148853 Aug 31 01:34:55.444443 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 486/989] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:34:55 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:34:56.465404 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-f9296afa-5f68-4c4d-b012-d8e246bb16aa tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:34:56.466050 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-f9296afa-5f68-4c4d-b012-d8e246bb16aa tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:34:56.472635 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f9296afa-5f68-4c4d-b012-d8e246bb16aa tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:34:56.473144 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f9296afa-5f68-4c4d-b012-d8e246bb16aa tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:34:56.473578 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f9296afa-5f68-4c4d-b012-d8e246bb16aa tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:34:56.474266 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f9296afa-5f68-4c4d-b012-d8e246bb16aa tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:34:56.474715 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f9296afa-5f68-4c4d-b012-d8e246bb16aa tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:34:56.475181 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f9296afa-5f68-4c4d-b012-d8e246bb16aa tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:34:56.607636 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-f9296afa-5f68-4c4d-b012-d8e246bb16aa tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:34:56.615397 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-f9296afa-5f68-4c4d-b012-d8e246bb16aa tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1569 microversion: 2.1 time: 0.153898 Aug 31 01:34:56.615974 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 504/990] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:34:56 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:34:57.637063 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-1158580e-6297-43be-a5d9-f28b85b5ac21 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:34:57.637708 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-1158580e-6297-43be-a5d9-f28b85b5ac21 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:34:57.644074 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1158580e-6297-43be-a5d9-f28b85b5ac21 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:34:57.644559 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1158580e-6297-43be-a5d9-f28b85b5ac21 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:34:57.645036 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1158580e-6297-43be-a5d9-f28b85b5ac21 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:34:57.645727 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1158580e-6297-43be-a5d9-f28b85b5ac21 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:34:57.646373 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1158580e-6297-43be-a5d9-f28b85b5ac21 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:34:57.646799 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1158580e-6297-43be-a5d9-f28b85b5ac21 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:34:57.774329 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-1158580e-6297-43be-a5d9-f28b85b5ac21 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:34:57.782039 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-1158580e-6297-43be-a5d9-f28b85b5ac21 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1569 microversion: 2.1 time: 0.149403 Aug 31 01:34:57.782720 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 487/991] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:34:57 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:34:58.803066 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-7c648228-f61c-47ef-b41d-682dd046d519 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:34:58.803679 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-7c648228-f61c-47ef-b41d-682dd046d519 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:34:58.810209 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7c648228-f61c-47ef-b41d-682dd046d519 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:34:58.810693 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7c648228-f61c-47ef-b41d-682dd046d519 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:34:58.811124 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7c648228-f61c-47ef-b41d-682dd046d519 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:34:58.811809 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7c648228-f61c-47ef-b41d-682dd046d519 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:34:58.812261 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7c648228-f61c-47ef-b41d-682dd046d519 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:34:58.812710 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-7c648228-f61c-47ef-b41d-682dd046d519 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:34:58.944791 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-7c648228-f61c-47ef-b41d-682dd046d519 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:34:58.952942 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-7c648228-f61c-47ef-b41d-682dd046d519 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1569 microversion: 2.1 time: 0.153729 Aug 31 01:34:58.953508 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 505/992] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:34:58 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:34:59.974818 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-eef99189-8165-45c0-befa-943bea3a5ec4 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:34:59.975434 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-eef99189-8165-45c0-befa-943bea3a5ec4 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:34:59.982623 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-eef99189-8165-45c0-befa-943bea3a5ec4 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:34:59.983109 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-eef99189-8165-45c0-befa-943bea3a5ec4 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:34:59.983560 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-eef99189-8165-45c0-befa-943bea3a5ec4 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:34:59.984244 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-eef99189-8165-45c0-befa-943bea3a5ec4 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:34:59.984699 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-eef99189-8165-45c0-befa-943bea3a5ec4 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:34:59.985146 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-eef99189-8165-45c0-befa-943bea3a5ec4 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:35:00.115465 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-eef99189-8165-45c0-befa-943bea3a5ec4 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:35:00.123409 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-eef99189-8165-45c0-befa-943bea3a5ec4 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1569 microversion: 2.1 time: 0.152409 Aug 31 01:35:00.123991 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 488/993] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:34:59 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:35:01.143574 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-3bd9c53f-4afe-410d-b0dc-43dae5a8ddb1 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:35:01.145575 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-3bd9c53f-4afe-410d-b0dc-43dae5a8ddb1 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:35:01.150449 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3bd9c53f-4afe-410d-b0dc-43dae5a8ddb1 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:35:01.150935 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3bd9c53f-4afe-410d-b0dc-43dae5a8ddb1 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:35:01.151433 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3bd9c53f-4afe-410d-b0dc-43dae5a8ddb1 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:35:01.152130 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3bd9c53f-4afe-410d-b0dc-43dae5a8ddb1 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:35:01.152587 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3bd9c53f-4afe-410d-b0dc-43dae5a8ddb1 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:35:01.153038 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3bd9c53f-4afe-410d-b0dc-43dae5a8ddb1 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:35:01.288885 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-3bd9c53f-4afe-410d-b0dc-43dae5a8ddb1 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:35:01.298011 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-3bd9c53f-4afe-410d-b0dc-43dae5a8ddb1 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1569 microversion: 2.1 time: 0.158152 Aug 31 01:35:01.298589 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 506/994] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:35:01 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:35:02.324605 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-f7d704c5-5062-4038-a742-eca1b0229d03 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:35:02.325238 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-f7d704c5-5062-4038-a742-eca1b0229d03 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:35:02.331842 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f7d704c5-5062-4038-a742-eca1b0229d03 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:35:02.332351 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f7d704c5-5062-4038-a742-eca1b0229d03 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:35:02.332797 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f7d704c5-5062-4038-a742-eca1b0229d03 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:35:02.333472 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f7d704c5-5062-4038-a742-eca1b0229d03 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:35:02.333912 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f7d704c5-5062-4038-a742-eca1b0229d03 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:35:02.334320 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f7d704c5-5062-4038-a742-eca1b0229d03 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:35:02.462916 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-f7d704c5-5062-4038-a742-eca1b0229d03 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:35:02.470684 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-f7d704c5-5062-4038-a742-eca1b0229d03 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1510 microversion: 2.1 time: 0.150581 Aug 31 01:35:02.471252 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 489/995] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:35:02 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:35:02.490825 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-17447d66-6577-4413-8a75-4823dbecef12 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:35:02.491423 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-17447d66-6577-4413-8a75-4823dbecef12 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:35:02.498414 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-17447d66-6577-4413-8a75-4823dbecef12 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:35:02.498894 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-17447d66-6577-4413-8a75-4823dbecef12 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:35:02.500547 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-17447d66-6577-4413-8a75-4823dbecef12 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:35:02.500547 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-17447d66-6577-4413-8a75-4823dbecef12 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:35:02.500547 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-17447d66-6577-4413-8a75-4823dbecef12 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:35:02.500935 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-17447d66-6577-4413-8a75-4823dbecef12 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:35:02.529330 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-17447d66-6577-4413-8a75-4823dbecef12 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121025) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 01:35:02.805688 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-17447d66-6577-4413-8a75-4823dbecef12 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "POST /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249/action" status: 202 len: 0 microversion: 2.1 time: 0.318778 Aug 31 01:35:02.806370 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 507/996] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 31 01:35:02 2022] POST /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 01:35:02.814539 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-e8236a0c-e12b-484b-8098-78cf783a3c01 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:35:02.815539 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-e8236a0c-e12b-484b-8098-78cf783a3c01 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:35:02.821433 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e8236a0c-e12b-484b-8098-78cf783a3c01 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:35:02.822399 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e8236a0c-e12b-484b-8098-78cf783a3c01 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:35:02.822842 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e8236a0c-e12b-484b-8098-78cf783a3c01 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:35:02.823534 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e8236a0c-e12b-484b-8098-78cf783a3c01 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:35:02.824130 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e8236a0c-e12b-484b-8098-78cf783a3c01 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:35:02.824555 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e8236a0c-e12b-484b-8098-78cf783a3c01 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:35:02.960973 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-bbd5ff8e-a989-4171-9914-647c908f1574 req-af8d9e78-4339-4a6f-98b1-426430f14df7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a8fe146-0b7b-4588-b312-2a525c4ca249", "name": "network-vif-unplugged", "status": "completed", "tag": "51e05401-efe1-4123-a876-e27cdccec893"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:35:02.969936 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-e8236a0c-e12b-484b-8098-78cf783a3c01 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:35:02.974333 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-bbd5ff8e-a989-4171-9914-647c908f1574 req-af8d9e78-4339-4a6f-98b1-426430f14df7 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:35:02.974958 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-bbd5ff8e-a989-4171-9914-647c908f1574 req-af8d9e78-4339-4a6f-98b1-426430f14df7 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:35:02.975683 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-bbd5ff8e-a989-4171-9914-647c908f1574 req-af8d9e78-4339-4a6f-98b1-426430f14df7 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:35:02.978015 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-e8236a0c-e12b-484b-8098-78cf783a3c01 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1518 microversion: 2.1 time: 0.167373 Aug 31 01:35:02.978895 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 490/997] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:35:02 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:35:02.994347 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.compute.server_external_events [req-bbd5ff8e-a989-4171-9914-647c908f1574 req-af8d9e78-4339-4a6f-98b1-426430f14df7 service nova] Unable to find a host for instance 9a8fe146-0b7b-4588-b312-2a525c4ca249. Dropping event network-vif-unplugged {{(pid=121025) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 31 01:35:02.995237 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-bbd5ff8e-a989-4171-9914-647c908f1574 req-af8d9e78-4339-4a6f-98b1-426430f14df7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.039472 Aug 31 01:35:02.995821 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 508/998] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 41 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 31 01:35:03.998176 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-ab460662-9d45-4751-b5e0-c0a6a77d86d7 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:35:03.998818 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-ab460662-9d45-4751-b5e0-c0a6a77d86d7 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:35:04.005222 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ab460662-9d45-4751-b5e0-c0a6a77d86d7 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:35:04.005699 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ab460662-9d45-4751-b5e0-c0a6a77d86d7 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:35:04.006125 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ab460662-9d45-4751-b5e0-c0a6a77d86d7 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:35:04.006807 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ab460662-9d45-4751-b5e0-c0a6a77d86d7 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:35:04.007254 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ab460662-9d45-4751-b5e0-c0a6a77d86d7 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:35:04.007671 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ab460662-9d45-4751-b5e0-c0a6a77d86d7 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:35:04.140311 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-ab460662-9d45-4751-b5e0-c0a6a77d86d7 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:35:04.148181 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-ab460662-9d45-4751-b5e0-c0a6a77d86d7 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1518 microversion: 2.1 time: 0.153888 Aug 31 01:35:04.148795 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 491/999] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:35:03 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:35:05.169766 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-a0441f29-81d4-42f3-8d1a-e7849e194010 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:35:05.170371 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-a0441f29-81d4-42f3-8d1a-e7849e194010 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:35:05.176768 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a0441f29-81d4-42f3-8d1a-e7849e194010 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:35:05.177246 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a0441f29-81d4-42f3-8d1a-e7849e194010 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:35:05.177676 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a0441f29-81d4-42f3-8d1a-e7849e194010 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:35:05.178349 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a0441f29-81d4-42f3-8d1a-e7849e194010 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:35:05.178794 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a0441f29-81d4-42f3-8d1a-e7849e194010 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:35:05.179212 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-a0441f29-81d4-42f3-8d1a-e7849e194010 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:35:05.310426 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-a0441f29-81d4-42f3-8d1a-e7849e194010 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:35:05.320496 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-a0441f29-81d4-42f3-8d1a-e7849e194010 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1518 microversion: 2.1 time: 0.154329 Aug 31 01:35:05.321511 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 509/1000] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:35:05 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:35:06.342834 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-d8d30884-9d4e-4fbe-bd44-efb0e006dcf5 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:35:06.343455 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-d8d30884-9d4e-4fbe-bd44-efb0e006dcf5 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:35:06.349876 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d8d30884-9d4e-4fbe-bd44-efb0e006dcf5 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:35:06.350668 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d8d30884-9d4e-4fbe-bd44-efb0e006dcf5 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:35:06.350812 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d8d30884-9d4e-4fbe-bd44-efb0e006dcf5 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:35:06.351458 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d8d30884-9d4e-4fbe-bd44-efb0e006dcf5 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:35:06.351905 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d8d30884-9d4e-4fbe-bd44-efb0e006dcf5 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:35:06.352323 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-d8d30884-9d4e-4fbe-bd44-efb0e006dcf5 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:35:06.487371 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-d8d30884-9d4e-4fbe-bd44-efb0e006dcf5 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:35:06.495161 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-d8d30884-9d4e-4fbe-bd44-efb0e006dcf5 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1518 microversion: 2.1 time: 0.156168 Aug 31 01:35:06.499211 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 492/1001] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:35:06 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:35:07.516919 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-fffa78c9-0849-4edb-a7c8-67f18d403ce3 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:35:07.517527 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-fffa78c9-0849-4edb-a7c8-67f18d403ce3 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:35:07.523936 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fffa78c9-0849-4edb-a7c8-67f18d403ce3 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:35:07.524411 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fffa78c9-0849-4edb-a7c8-67f18d403ce3 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:35:07.525360 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fffa78c9-0849-4edb-a7c8-67f18d403ce3 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:35:07.526092 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fffa78c9-0849-4edb-a7c8-67f18d403ce3 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:35:07.526537 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fffa78c9-0849-4edb-a7c8-67f18d403ce3 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:35:07.526951 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fffa78c9-0849-4edb-a7c8-67f18d403ce3 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:35:07.675300 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-fffa78c9-0849-4edb-a7c8-67f18d403ce3 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:35:07.682977 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-fffa78c9-0849-4edb-a7c8-67f18d403ce3 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1518 microversion: 2.1 time: 0.170022 Aug 31 01:35:07.686400 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 510/1002] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:35:07 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1518 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:35:08.703719 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-9a6e1990-c07d-402a-aeab-0b50d5184794 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:35:08.704323 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-9a6e1990-c07d-402a-aeab-0b50d5184794 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:35:08.710555 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9a6e1990-c07d-402a-aeab-0b50d5184794 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:35:08.711036 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9a6e1990-c07d-402a-aeab-0b50d5184794 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:35:08.711460 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9a6e1990-c07d-402a-aeab-0b50d5184794 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:35:08.712151 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9a6e1990-c07d-402a-aeab-0b50d5184794 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:35:08.712593 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9a6e1990-c07d-402a-aeab-0b50d5184794 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:35:08.713037 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-9a6e1990-c07d-402a-aeab-0b50d5184794 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:35:08.846196 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-9a6e1990-c07d-402a-aeab-0b50d5184794 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:35:08.854368 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-9a6e1990-c07d-402a-aeab-0b50d5184794 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1520 microversion: 2.1 time: 0.154265 Aug 31 01:35:08.854944 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 493/1003] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:35:08 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:35:09.879332 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-8ea6d434-a964-459a-a5ac-1681ae9d48c2 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:35:09.880037 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-8ea6d434-a964-459a-a5ac-1681ae9d48c2 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:35:09.886845 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8ea6d434-a964-459a-a5ac-1681ae9d48c2 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:35:09.887470 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8ea6d434-a964-459a-a5ac-1681ae9d48c2 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:35:09.887904 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8ea6d434-a964-459a-a5ac-1681ae9d48c2 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:35:09.888628 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8ea6d434-a964-459a-a5ac-1681ae9d48c2 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:35:09.889111 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8ea6d434-a964-459a-a5ac-1681ae9d48c2 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:35:09.889534 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-8ea6d434-a964-459a-a5ac-1681ae9d48c2 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:35:10.022400 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-8ea6d434-a964-459a-a5ac-1681ae9d48c2 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:35:10.030148 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-8ea6d434-a964-459a-a5ac-1681ae9d48c2 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1576 microversion: 2.1 time: 0.155179 Aug 31 01:35:10.030722 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 511/1004] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:35:09 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:35:11.053713 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-f1d9655e-fcf6-445a-b878-e8dc5306067d tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:35:11.054795 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-f1d9655e-fcf6-445a-b878-e8dc5306067d tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:35:11.061105 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f1d9655e-fcf6-445a-b878-e8dc5306067d tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:35:11.061584 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f1d9655e-fcf6-445a-b878-e8dc5306067d tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:35:11.062020 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f1d9655e-fcf6-445a-b878-e8dc5306067d tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:35:11.062714 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f1d9655e-fcf6-445a-b878-e8dc5306067d tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:35:11.063167 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f1d9655e-fcf6-445a-b878-e8dc5306067d tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:35:11.063589 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f1d9655e-fcf6-445a-b878-e8dc5306067d tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:35:11.198017 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-f1d9655e-fcf6-445a-b878-e8dc5306067d tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:35:11.204058 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-f1d9655e-fcf6-445a-b878-e8dc5306067d tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1576 microversion: 2.1 time: 0.156209 Aug 31 01:35:11.204634 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 494/1005] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:35:11 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:35:12.225118 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-fbbdebfa-cebe-416c-a0db-6cf259dd97c8 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:35:12.225728 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-fbbdebfa-cebe-416c-a0db-6cf259dd97c8 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:35:12.232693 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fbbdebfa-cebe-416c-a0db-6cf259dd97c8 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:35:12.233197 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fbbdebfa-cebe-416c-a0db-6cf259dd97c8 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:35:12.233625 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fbbdebfa-cebe-416c-a0db-6cf259dd97c8 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:35:12.234305 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fbbdebfa-cebe-416c-a0db-6cf259dd97c8 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:35:12.234750 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fbbdebfa-cebe-416c-a0db-6cf259dd97c8 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:35:12.235164 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fbbdebfa-cebe-416c-a0db-6cf259dd97c8 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:35:12.362819 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-fbbdebfa-cebe-416c-a0db-6cf259dd97c8 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:35:12.370600 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-fbbdebfa-cebe-416c-a0db-6cf259dd97c8 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1576 microversion: 2.1 time: 0.149366 Aug 31 01:35:12.371159 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 512/1006] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:35:12 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:35:13.391535 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-36820f6b-7278-4eb1-9689-1940881e374a tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:35:13.392145 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-36820f6b-7278-4eb1-9689-1940881e374a tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:35:13.398638 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-36820f6b-7278-4eb1-9689-1940881e374a tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:35:13.399114 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-36820f6b-7278-4eb1-9689-1940881e374a tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:35:13.399543 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-36820f6b-7278-4eb1-9689-1940881e374a tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:35:13.400225 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-36820f6b-7278-4eb1-9689-1940881e374a tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:35:13.400673 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-36820f6b-7278-4eb1-9689-1940881e374a tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:35:13.401137 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-36820f6b-7278-4eb1-9689-1940881e374a tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:35:13.534676 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-36820f6b-7278-4eb1-9689-1940881e374a tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:35:13.542382 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-36820f6b-7278-4eb1-9689-1940881e374a tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1576 microversion: 2.1 time: 0.154774 Aug 31 01:35:13.543129 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 495/1007] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:35:13 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:35:14.563765 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-cd243b2e-8c3e-4b04-8541-da0e0d1f77e4 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:35:14.564306 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-cd243b2e-8c3e-4b04-8541-da0e0d1f77e4 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:35:14.571083 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cd243b2e-8c3e-4b04-8541-da0e0d1f77e4 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:35:14.571563 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cd243b2e-8c3e-4b04-8541-da0e0d1f77e4 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:35:14.572018 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cd243b2e-8c3e-4b04-8541-da0e0d1f77e4 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:35:14.572698 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cd243b2e-8c3e-4b04-8541-da0e0d1f77e4 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:35:14.573166 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cd243b2e-8c3e-4b04-8541-da0e0d1f77e4 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:35:14.573612 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-cd243b2e-8c3e-4b04-8541-da0e0d1f77e4 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:35:14.706517 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-cd243b2e-8c3e-4b04-8541-da0e0d1f77e4 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:35:14.714108 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-cd243b2e-8c3e-4b04-8541-da0e0d1f77e4 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1576 microversion: 2.1 time: 0.154412 Aug 31 01:35:14.715533 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 513/1008] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:35:14 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:35:15.736519 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-01976782-1c52-4c4d-9ccd-a27958156a0e tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:35:15.737202 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-01976782-1c52-4c4d-9ccd-a27958156a0e tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:35:15.743670 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-01976782-1c52-4c4d-9ccd-a27958156a0e tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:35:15.744154 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-01976782-1c52-4c4d-9ccd-a27958156a0e tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:35:15.744587 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-01976782-1c52-4c4d-9ccd-a27958156a0e tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:35:15.745299 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-01976782-1c52-4c4d-9ccd-a27958156a0e tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:35:15.745754 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-01976782-1c52-4c4d-9ccd-a27958156a0e tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:35:15.746174 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-01976782-1c52-4c4d-9ccd-a27958156a0e tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:35:15.883623 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-01976782-1c52-4c4d-9ccd-a27958156a0e tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:35:15.891469 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-01976782-1c52-4c4d-9ccd-a27958156a0e tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1576 microversion: 2.1 time: 0.158835 Aug 31 01:35:15.892041 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 496/1009] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:35:15 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:35:16.913123 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-c68f8102-4434-4227-878a-3e069d70fe4d tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:35:16.913733 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-c68f8102-4434-4227-878a-3e069d70fe4d tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:35:16.920041 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c68f8102-4434-4227-878a-3e069d70fe4d tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:35:16.920528 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c68f8102-4434-4227-878a-3e069d70fe4d tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:35:16.921010 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c68f8102-4434-4227-878a-3e069d70fe4d tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:35:16.921706 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c68f8102-4434-4227-878a-3e069d70fe4d tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:35:16.922164 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c68f8102-4434-4227-878a-3e069d70fe4d tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:35:16.922589 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c68f8102-4434-4227-878a-3e069d70fe4d tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:35:16.926632 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:35:17.055811 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-c68f8102-4434-4227-878a-3e069d70fe4d tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:35:17.063612 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-c68f8102-4434-4227-878a-3e069d70fe4d tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1576 microversion: 2.1 time: 0.154369 Aug 31 01:35:17.064186 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 514/1010] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:35:16 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:35:18.085543 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-53feb9bb-084b-4e2e-8120-d21ba40bfc04 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:35:18.086157 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-53feb9bb-084b-4e2e-8120-d21ba40bfc04 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:35:18.092516 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-53feb9bb-084b-4e2e-8120-d21ba40bfc04 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:35:18.093026 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-53feb9bb-084b-4e2e-8120-d21ba40bfc04 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:35:18.093463 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-53feb9bb-084b-4e2e-8120-d21ba40bfc04 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:35:18.094147 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-53feb9bb-084b-4e2e-8120-d21ba40bfc04 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:35:18.094600 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-53feb9bb-084b-4e2e-8120-d21ba40bfc04 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:35:18.095021 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-53feb9bb-084b-4e2e-8120-d21ba40bfc04 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:35:18.222058 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-53feb9bb-084b-4e2e-8120-d21ba40bfc04 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:35:18.229703 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-53feb9bb-084b-4e2e-8120-d21ba40bfc04 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1576 microversion: 2.1 time: 0.148065 Aug 31 01:35:18.230774 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 497/1011] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:35:18 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:35:19.068501 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-4a4fa3ac-87ad-4242-848b-c684dc4239c3 req-7c87b796-9459-45f5-ba3e-225ea6730ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a8fe146-0b7b-4588-b312-2a525c4ca249", "name": "network-vif-plugged", "status": "completed", "tag": "51e05401-efe1-4123-a876-e27cdccec893"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:35:19.074239 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:35:19.079229 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-4a4fa3ac-87ad-4242-848b-c684dc4239c3 req-7c87b796-9459-45f5-ba3e-225ea6730ca9 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:35:19.083868 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-4a4fa3ac-87ad-4242-848b-c684dc4239c3 req-7c87b796-9459-45f5-ba3e-225ea6730ca9 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:35:19.083868 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-4a4fa3ac-87ad-4242-848b-c684dc4239c3 req-7c87b796-9459-45f5-ba3e-225ea6730ca9 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:35:19.091420 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-4a4fa3ac-87ad-4242-848b-c684dc4239c3 req-7c87b796-9459-45f5-ba3e-225ea6730ca9 service nova] Creating event network-vif-plugged:51e05401-efe1-4123-a876-e27cdccec893 for instance 9a8fe146-0b7b-4588-b312-2a525c4ca249 on hv-cinder-85528 Aug 31 01:35:19.096661 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-4a4fa3ac-87ad-4242-848b-c684dc4239c3 req-7c87b796-9459-45f5-ba3e-225ea6730ca9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031836 Aug 31 01:35:19.097284 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 515/1012] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:35:19.250429 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-5f25d60c-ff15-4b79-8372-6ef756ffaf0c tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:35:19.251045 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-5f25d60c-ff15-4b79-8372-6ef756ffaf0c tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:35:19.253420 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_api:SELECT=31 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:35:19.258040 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5f25d60c-ff15-4b79-8372-6ef756ffaf0c tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:35:19.258528 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5f25d60c-ff15-4b79-8372-6ef756ffaf0c tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:35:19.258967 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5f25d60c-ff15-4b79-8372-6ef756ffaf0c tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:35:19.259657 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5f25d60c-ff15-4b79-8372-6ef756ffaf0c tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:35:19.260113 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5f25d60c-ff15-4b79-8372-6ef756ffaf0c tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:35:19.260535 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5f25d60c-ff15-4b79-8372-6ef756ffaf0c tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:35:19.265029 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell1:SELECT=91 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:35:19.396852 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-5f25d60c-ff15-4b79-8372-6ef756ffaf0c tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:35:19.404854 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-5f25d60c-ff15-4b79-8372-6ef756ffaf0c tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1576 microversion: 2.1 time: 0.158290 Aug 31 01:35:19.405426 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 498/1013] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:35:19 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:35:20.426981 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-45a81ba0-8b7a-4376-9245-d62367ac8b6f tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:35:20.427674 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-45a81ba0-8b7a-4376-9245-d62367ac8b6f tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:35:20.434314 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-45a81ba0-8b7a-4376-9245-d62367ac8b6f tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:35:20.434801 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-45a81ba0-8b7a-4376-9245-d62367ac8b6f tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:35:20.435229 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-45a81ba0-8b7a-4376-9245-d62367ac8b6f tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:35:20.435915 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-45a81ba0-8b7a-4376-9245-d62367ac8b6f tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:35:20.436361 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-45a81ba0-8b7a-4376-9245-d62367ac8b6f tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:35:20.436815 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-45a81ba0-8b7a-4376-9245-d62367ac8b6f tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:35:20.572831 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-45a81ba0-8b7a-4376-9245-d62367ac8b6f tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:35:20.581600 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-45a81ba0-8b7a-4376-9245-d62367ac8b6f tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1576 microversion: 2.1 time: 0.159467 Aug 31 01:35:20.582166 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 516/1014] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:35:20 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:35:21.603548 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-7911765c-8d7d-413a-a28b-cecb1777499e tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:35:21.604162 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-7911765c-8d7d-413a-a28b-cecb1777499e tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:35:21.611344 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7911765c-8d7d-413a-a28b-cecb1777499e tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:35:21.611821 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7911765c-8d7d-413a-a28b-cecb1777499e tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:35:21.612247 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7911765c-8d7d-413a-a28b-cecb1777499e tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:35:21.612950 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7911765c-8d7d-413a-a28b-cecb1777499e tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:35:21.613399 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7911765c-8d7d-413a-a28b-cecb1777499e tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:35:21.613813 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-7911765c-8d7d-413a-a28b-cecb1777499e tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:35:21.741674 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-7911765c-8d7d-413a-a28b-cecb1777499e tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:35:21.749353 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-7911765c-8d7d-413a-a28b-cecb1777499e tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1563 microversion: 2.1 time: 0.149710 Aug 31 01:35:21.749915 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 499/1015] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:35:21 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1563 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:35:59.791568 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-99beb89c-d4fa-4692-8277-67457a0d16b4 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:35:59.792210 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-99beb89c-d4fa-4692-8277-67457a0d16b4 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: e78060b8-25a5-43e3-8deb-d59bd2b3bae6] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:35:59.794589 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_api:SELECT=3 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:35:59.795235 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell1:SELECT=12 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:35:59.800360 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-99beb89c-d4fa-4692-8277-67457a0d16b4 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:35:59.808681 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-99beb89c-d4fa-4692-8277-67457a0d16b4 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:35:59.808681 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-99beb89c-d4fa-4692-8277-67457a0d16b4 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:35:59.808681 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-99beb89c-d4fa-4692-8277-67457a0d16b4 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:35:59.808681 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-99beb89c-d4fa-4692-8277-67457a0d16b4 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:35:59.809285 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-99beb89c-d4fa-4692-8277-67457a0d16b4 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:35:59.829453 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-99beb89c-d4fa-4692-8277-67457a0d16b4 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: e78060b8-25a5-43e3-8deb-d59bd2b3bae6] Going to try to terminate instance {{(pid=121025) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 01:36:00.100908 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-99beb89c-d4fa-4692-8277-67457a0d16b4 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6" status: 204 len: 0 microversion: 2.1 time: 0.312903 Aug 31 01:36:00.101407 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 517/1016] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 01:35:59 2022] DELETE /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 01:36:00.109636 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-8c882117-b2e8-49ac-8e50-3c3c006fa5ed tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:36:00.110272 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-8c882117-b2e8-49ac-8e50-3c3c006fa5ed tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: e78060b8-25a5-43e3-8deb-d59bd2b3bae6] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:36:00.113036 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_api:SELECT=3 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:36:00.113686 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell1:SELECT=11 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:36:00.114734 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 31 01:36:00.119780 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8c882117-b2e8-49ac-8e50-3c3c006fa5ed tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:00.120253 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8c882117-b2e8-49ac-8e50-3c3c006fa5ed tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:00.120680 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8c882117-b2e8-49ac-8e50-3c3c006fa5ed tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:00.121381 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8c882117-b2e8-49ac-8e50-3c3c006fa5ed tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:00.121823 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8c882117-b2e8-49ac-8e50-3c3c006fa5ed tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:00.122235 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8c882117-b2e8-49ac-8e50-3c3c006fa5ed tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:00.255590 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-8c882117-b2e8-49ac-8e50-3c3c006fa5ed tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:36:00.263788 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-8c882117-b2e8-49ac-8e50-3c3c006fa5ed tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6" status: 200 len: 1577 microversion: 2.1 time: 0.157874 Aug 31 01:36:00.265134 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 500/1017] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:36:00 2022] GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:36:01.287471 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-b15f7eeb-0e5c-43b7-8462-685ff6172511 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:36:01.288429 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-b15f7eeb-0e5c-43b7-8462-685ff6172511 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: e78060b8-25a5-43e3-8deb-d59bd2b3bae6] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:36:01.295612 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b15f7eeb-0e5c-43b7-8462-685ff6172511 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:01.296118 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b15f7eeb-0e5c-43b7-8462-685ff6172511 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:01.296547 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b15f7eeb-0e5c-43b7-8462-685ff6172511 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:01.297274 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b15f7eeb-0e5c-43b7-8462-685ff6172511 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:01.297721 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b15f7eeb-0e5c-43b7-8462-685ff6172511 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:01.298177 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-b15f7eeb-0e5c-43b7-8462-685ff6172511 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:01.430089 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-b15f7eeb-0e5c-43b7-8462-685ff6172511 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:36:01.437745 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-b15f7eeb-0e5c-43b7-8462-685ff6172511 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6" status: 200 len: 1577 microversion: 2.1 time: 0.155191 Aug 31 01:36:01.438302 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 518/1018] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:36:01 2022] GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:36:02.459953 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-3be8d4e6-f3e8-4c0d-a11c-6cb5ca31a43e tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:36:02.460652 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-3be8d4e6-f3e8-4c0d-a11c-6cb5ca31a43e tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: e78060b8-25a5-43e3-8deb-d59bd2b3bae6] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:36:02.469251 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3be8d4e6-f3e8-4c0d-a11c-6cb5ca31a43e tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:02.469747 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3be8d4e6-f3e8-4c0d-a11c-6cb5ca31a43e tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:02.470186 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3be8d4e6-f3e8-4c0d-a11c-6cb5ca31a43e tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:02.470890 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3be8d4e6-f3e8-4c0d-a11c-6cb5ca31a43e tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:02.471353 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3be8d4e6-f3e8-4c0d-a11c-6cb5ca31a43e tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:02.471777 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-3be8d4e6-f3e8-4c0d-a11c-6cb5ca31a43e tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:02.495195 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-f60417cf-1479-4c8c-88d6-698b4e2bae4b req-f4a97205-a198-4e27-99e2-7b1321c8f9e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e78060b8-25a5-43e3-8deb-d59bd2b3bae6", "name": "network-vif-deleted", "tag": "4278caa6-ff39-4080-94a7-80095f21e419"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:36:02.505079 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-f60417cf-1479-4c8c-88d6-698b4e2bae4b req-f4a97205-a198-4e27-99e2-7b1321c8f9e1 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:02.513764 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-f60417cf-1479-4c8c-88d6-698b4e2bae4b req-f4a97205-a198-4e27-99e2-7b1321c8f9e1 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:02.513764 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-f60417cf-1479-4c8c-88d6-698b4e2bae4b req-f4a97205-a198-4e27-99e2-7b1321c8f9e1 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:02.517634 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-f60417cf-1479-4c8c-88d6-698b4e2bae4b req-f4a97205-a198-4e27-99e2-7b1321c8f9e1 service nova] Creating event network-vif-deleted:4278caa6-ff39-4080-94a7-80095f21e419 for instance e78060b8-25a5-43e3-8deb-d59bd2b3bae6 on hv-cinder-85528 Aug 31 01:36:02.523764 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-f60417cf-1479-4c8c-88d6-698b4e2bae4b req-f4a97205-a198-4e27-99e2-7b1321c8f9e1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032210 Aug 31 01:36:02.524841 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 519/1019] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:36:02.543670 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-3be8d4e6-f3e8-4c0d-a11c-6cb5ca31a43e tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:36:02.551921 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-3be8d4e6-f3e8-4c0d-a11c-6cb5ca31a43e tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6" status: 200 len: 1509 microversion: 2.1 time: 0.096955 Aug 31 01:36:02.552838 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 501/1020] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:36:02 2022] GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6 => generated 1509 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:36:03.574227 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-fb70f2f9-f89a-4a6c-a659-014a62795614 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:36:03.575054 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-fb70f2f9-f89a-4a6c-a659-014a62795614 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: e78060b8-25a5-43e3-8deb-d59bd2b3bae6] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:36:03.581539 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fb70f2f9-f89a-4a6c-a659-014a62795614 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:03.582022 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fb70f2f9-f89a-4a6c-a659-014a62795614 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:03.582461 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fb70f2f9-f89a-4a6c-a659-014a62795614 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:03.583136 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fb70f2f9-f89a-4a6c-a659-014a62795614 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:03.583576 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fb70f2f9-f89a-4a6c-a659-014a62795614 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:03.583994 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fb70f2f9-f89a-4a6c-a659-014a62795614 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:03.617716 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fb70f2f9-f89a-4a6c-a659-014a62795614 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:03.617716 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fb70f2f9-f89a-4a6c-a659-014a62795614 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:03.617716 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fb70f2f9-f89a-4a6c-a659-014a62795614 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:03.617716 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.objects.instance [None req-fb70f2f9-f89a-4a6c-a659-014a62795614 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lazy-loading 'fault' on Instance uuid e78060b8-25a5-43e3-8deb-d59bd2b3bae6 {{(pid=121025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:36:03.662757 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-fb70f2f9-f89a-4a6c-a659-014a62795614 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:36:03.670669 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-fb70f2f9-f89a-4a6c-a659-014a62795614 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6" status: 200 len: 1230 microversion: 2.1 time: 0.101079 Aug 31 01:36:03.671396 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 520/1021] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:36:03 2022] GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6 => generated 1230 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:36:04.693560 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-60decd35-c85a-4077-9307-f3153e008a26 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:36:04.694168 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-60decd35-c85a-4077-9307-f3153e008a26 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: e78060b8-25a5-43e3-8deb-d59bd2b3bae6] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:36:04.700758 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-60decd35-c85a-4077-9307-f3153e008a26 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:04.701360 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-60decd35-c85a-4077-9307-f3153e008a26 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:04.701791 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-60decd35-c85a-4077-9307-f3153e008a26 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:04.702474 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-60decd35-c85a-4077-9307-f3153e008a26 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:04.702920 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-60decd35-c85a-4077-9307-f3153e008a26 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:04.703342 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-60decd35-c85a-4077-9307-f3153e008a26 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:04.721176 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.wsgi [None req-60decd35-c85a-4077-9307-f3153e008a26 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] HTTP exception thrown: Instance e78060b8-25a5-43e3-8deb-d59bd2b3bae6 could not be found. Aug 31 01:36:04.722825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-60decd35-c85a-4077-9307-f3153e008a26 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Request method failure captured: Aug 31 01:36:04.722825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: request: GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6 HTTP/1.1 Aug 31 01:36:04.722825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept: application/json Aug 31 01:36:04.722825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept-Encoding: identity Aug 31 01:36:04.722825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Connection: close Aug 31 01:36:04.722825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Length: 0 Aug 31 01:36:04.722825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Type: application/json Aug 31 01:36:04.722825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Host: 10.222.0.20 Aug 31 01:36:04.722825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Openstack-System-Scope: None Aug 31 01:36:04.722825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: User-Agent: python-urllib3/1.26.12 Aug 31 01:36:04.722825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Auth-Token: gAAAAABjDrpiJGdXCI4jVMIXYsmScftUT7MJxM0vP5BowPrqnvdwid_cRehcrCvueRxHFkr4Nxd3gRgtS0w_ZG4Y5GC3KnWo43Lev3tBzfgdsKEF8rfhn7EAHBil0LqDyZWCvMJ3HKm-PDLBGvya_WTlE6e-o7NwfcMDXuOl3dxRGWYhIbDRyvE Aug 31 01:36:04.722825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Id: None Aug 31 01:36:04.722825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Name: None Aug 31 01:36:04.722825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Identity-Status: Confirmed Aug 31 01:36:04.722825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Is-Admin-Project: True Aug 31 01:36:04.722825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Id: default Aug 31 01:36:04.722825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Name: Default Aug 31 01:36:04.722825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Id: 8a6177d84e534b358b475672f474f6df Aug 31 01:36:04.722825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Name: tempest-TestVolumeBootPattern-1166927824 Aug 31 01:36:04.722825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Role: member,reader Aug 31 01:36:04.722825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Roles: member,reader Aug 31 01:36:04.724532 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8a6177d84e534b358b475672f474f6df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8a6177d84e534b358b475672f474f6df", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8a6177d84e534b358b475672f474f6df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8a6177d84e534b358b475672f474f6df"}]}] Aug 31 01:36:04.724532 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant: tempest-TestVolumeBootPattern-1166927824 Aug 31 01:36:04.724532 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Id: 8a6177d84e534b358b475672f474f6df Aug 31 01:36:04.724532 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Name: tempest-TestVolumeBootPattern-1166927824 Aug 31 01:36:04.724532 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User: tempest-TestVolumeBootPattern-1166927824-project Aug 31 01:36:04.724532 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Id: default Aug 31 01:36:04.724532 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Name: Default Aug 31 01:36:04.724532 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Id: af97536937fb405198e1474fc134b493 Aug 31 01:36:04.724532 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Name: tempest-TestVolumeBootPattern-1166927824-project Aug 31 01:36:04.724532 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: method: > Aug 31 01:36:04.724532 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: exception: Instance e78060b8-25a5-43e3-8deb-d59bd2b3bae6 could not be found. Aug 31 01:36:04.724532 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: action_args: {'id': 'e78060b8-25a5-43e3-8deb-d59bd2b3bae6'} Aug 31 01:36:04.725587 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:36:04.725587 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:36:04.725587 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:36:04.725587 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:36:04.725587 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:36:04.725587 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:36:04.725587 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:36:04.725587 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:36:04.725587 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:36:04.725587 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:36:04.725587 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e78060b8-25a5-43e3-8deb-d59bd2b3bae6 could not be found. Aug 31 01:36:04.725587 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:36:04.725587 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:36:04.725587 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:36:04.725587 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:36:04.725587 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:36:04.725587 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:36:04.725587 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:36:04.725587 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:36:04.725587 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:36:04.727143 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:36:04.727143 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:36:04.727143 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:36:04.727143 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:36:04.727143 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:36:04.727143 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:36:04.727143 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:36:04.727143 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e78060b8-25a5-43e3-8deb-d59bd2b3bae6 could not be found. Aug 31 01:36:04.727143 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:36:04.727143 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:36:04.727143 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:36:04.727143 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:36:04.727143 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:36:04.727143 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:36:04.727143 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:36:04.727143 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:36:04.727143 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e78060b8-25a5-43e3-8deb-d59bd2b3bae6 could not be found. Aug 31 01:36:04.727143 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:36:04.728590 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-60decd35-c85a-4077-9307-f3153e008a26 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Returning 404 to user: Instance e78060b8-25a5-43e3-8deb-d59bd2b3bae6 could not be found. {{(pid=121026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:36:04.728590 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-60decd35-c85a-4077-9307-f3153e008a26 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6" status: 404 len: 111 microversion: 2.1 time: 0.035368 Aug 31 01:36:04.728590 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 502/1022] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:36:04 2022] GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:36:04.773426 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-f384740f-d2cf-4d16-b5be-228887fc5f45 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1969503476", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1559894197", "security_groups": [{"name": "tempest-secgroup-smoke-1481444852"}], "block_device_mapping_v2": [{"uuid": "55444754-ac90-4c8c-b1b5-7f3ae741c833", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1c20fdf4-c01e-4a42-bd98-933028a4956d"}]}} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:36:04.884154 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.network.neutron [None req-f384740f-d2cf-4d16-b5be-228887fc5f45 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] validate_networks() for [('1c20fdf4-c01e-4a42-bd98-933028a4956d', None, None, None, None, None)] {{(pid=121025) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 01:36:05.508319 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-f384740f-d2cf-4d16-b5be-228887fc5f45 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Flavor limits 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 01:36:05.508775 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-f384740f-d2cf-4d16-b5be-228887fc5f45 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Image limits 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 01:36:05.509283 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-f384740f-d2cf-4d16-b5be-228887fc5f45 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Flavor pref 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 01:36:05.509692 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-f384740f-d2cf-4d16-b5be-228887fc5f45 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Image pref 0:0:0 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 01:36:05.510104 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.virt.hardware [None req-f384740f-d2cf-4d16-b5be-228887fc5f45 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 01:36:05.519357 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f384740f-d2cf-4d16-b5be-228887fc5f45 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:05.519839 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f384740f-d2cf-4d16-b5be-228887fc5f45 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:05.520272 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f384740f-d2cf-4d16-b5be-228887fc5f45 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:05.521048 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f384740f-d2cf-4d16-b5be-228887fc5f45 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:05.521503 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f384740f-d2cf-4d16-b5be-228887fc5f45 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:05.521932 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-f384740f-d2cf-4d16-b5be-228887fc5f45 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:05.538046 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.quota [None req-f384740f-d2cf-4d16-b5be-228887fc5f45 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Getting quotas for project 8a6177d84e534b358b475672f474f6df. Resources: {'instances', 'cores', 'ram'} {{(pid=121025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 01:36:05.541930 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.quota [None req-f384740f-d2cf-4d16-b5be-228887fc5f45 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Getting quotas for user af97536937fb405198e1474fc134b493 and project 8a6177d84e534b358b475672f474f6df. Resources: {'instances', 'cores', 'ram'} {{(pid=121025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 01:36:05.597603 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-f384740f-d2cf-4d16-b5be-228887fc5f45 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Going to run 1 instances... {{(pid=121025) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 01:36:05.599765 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-f384740f-d2cf-4d16-b5be-228887fc5f45 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: 577caa63-5dbe-4508-8004-488bd8d79ac7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='55444754-ac90-4c8c-b1b5-7f3ae741c833',volume_size=None,volume_type=None)] {{(pid=121025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 01:36:06.027473 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-f384740f-d2cf-4d16-b5be-228887fc5f45 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.257862 Aug 31 01:36:06.028426 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 521/1023] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 31 01:36:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 1260 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 01:36:06.039212 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-002da09c-cb6d-4e93-b68e-6b929642def0 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:36:06.039825 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-002da09c-cb6d-4e93-b68e-6b929642def0 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: 577caa63-5dbe-4508-8004-488bd8d79ac7] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:36:06.091964 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-002da09c-cb6d-4e93-b68e-6b929642def0 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:36:06.099441 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-002da09c-cb6d-4e93-b68e-6b929642def0 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/577caa63-5dbe-4508-8004-488bd8d79ac7" status: 200 len: 1095 microversion: 2.1 time: 0.063965 Aug 31 01:36:06.100015 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 503/1024] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:36:06 2022] GET /compute/v2.1/servers/577caa63-5dbe-4508-8004-488bd8d79ac7 => generated 1095 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:36:07.120184 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-24f4942a-788e-44cd-9612-f855765a85b2 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:36:07.120817 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-24f4942a-788e-44cd-9612-f855765a85b2 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: 577caa63-5dbe-4508-8004-488bd8d79ac7] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:36:07.127190 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-24f4942a-788e-44cd-9612-f855765a85b2 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:07.127392 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-24f4942a-788e-44cd-9612-f855765a85b2 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:07.128347 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-24f4942a-788e-44cd-9612-f855765a85b2 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:07.129050 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-24f4942a-788e-44cd-9612-f855765a85b2 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:07.129499 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-24f4942a-788e-44cd-9612-f855765a85b2 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:07.129915 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-24f4942a-788e-44cd-9612-f855765a85b2 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:07.196889 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-24f4942a-788e-44cd-9612-f855765a85b2 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:36:07.199866 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-24f4942a-788e-44cd-9612-f855765a85b2 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/577caa63-5dbe-4508-8004-488bd8d79ac7" status: 200 len: 1145 microversion: 2.1 time: 0.084010 Aug 31 01:36:07.200456 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 522/1025] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:36:07 2022] GET /compute/v2.1/servers/577caa63-5dbe-4508-8004-488bd8d79ac7 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:36:08.220111 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-2f8b0d2a-70e4-4a87-b020-332580ef4a0f tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:36:08.220750 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-2f8b0d2a-70e4-4a87-b020-332580ef4a0f tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: 577caa63-5dbe-4508-8004-488bd8d79ac7] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:36:08.228575 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-2f8b0d2a-70e4-4a87-b020-332580ef4a0f tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:08.229084 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-2f8b0d2a-70e4-4a87-b020-332580ef4a0f tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:08.229741 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-2f8b0d2a-70e4-4a87-b020-332580ef4a0f tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:08.230443 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-2f8b0d2a-70e4-4a87-b020-332580ef4a0f tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:08.230898 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-2f8b0d2a-70e4-4a87-b020-332580ef4a0f tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:08.231509 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-2f8b0d2a-70e4-4a87-b020-332580ef4a0f tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:08.295166 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-2f8b0d2a-70e4-4a87-b020-332580ef4a0f tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:36:08.303474 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-2f8b0d2a-70e4-4a87-b020-332580ef4a0f tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/577caa63-5dbe-4508-8004-488bd8d79ac7" status: 200 len: 1211 microversion: 2.1 time: 0.086590 Aug 31 01:36:08.303474 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 504/1026] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:36:08 2022] GET /compute/v2.1/servers/577caa63-5dbe-4508-8004-488bd8d79ac7 => generated 1211 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:36:09.326071 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-df35ff9f-2127-4f3f-b31a-e839de49b1be tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:36:09.327148 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-df35ff9f-2127-4f3f-b31a-e839de49b1be tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: 577caa63-5dbe-4508-8004-488bd8d79ac7] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:36:09.335257 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-df35ff9f-2127-4f3f-b31a-e839de49b1be tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:09.335747 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-df35ff9f-2127-4f3f-b31a-e839de49b1be tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:09.336915 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-df35ff9f-2127-4f3f-b31a-e839de49b1be tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:09.337593 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-df35ff9f-2127-4f3f-b31a-e839de49b1be tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:09.338051 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-df35ff9f-2127-4f3f-b31a-e839de49b1be tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:09.338447 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-df35ff9f-2127-4f3f-b31a-e839de49b1be tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:09.478098 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-df35ff9f-2127-4f3f-b31a-e839de49b1be tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:36:09.485763 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-df35ff9f-2127-4f3f-b31a-e839de49b1be tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/577caa63-5dbe-4508-8004-488bd8d79ac7" status: 200 len: 1279 microversion: 2.1 time: 0.164952 Aug 31 01:36:09.486338 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 523/1027] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:36:09 2022] GET /compute/v2.1/servers/577caa63-5dbe-4508-8004-488bd8d79ac7 => generated 1279 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:36:09.932380 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [req-ff564032-2e6f-44cc-ae19-a5d117d87b12 req-2e3fdbdb-7855-4c2a-9596-a77a1c15681b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "577caa63-5dbe-4508-8004-488bd8d79ac7", "tag": "a4851ee9-cb6c-453e-b0ec-22dce2143857"}]} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:36:09.942458 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-ff564032-2e6f-44cc-ae19-a5d117d87b12 req-2e3fdbdb-7855-4c2a-9596-a77a1c15681b service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:09.942932 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-ff564032-2e6f-44cc-ae19-a5d117d87b12 req-2e3fdbdb-7855-4c2a-9596-a77a1c15681b service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:09.943360 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-ff564032-2e6f-44cc-ae19-a5d117d87b12 req-2e3fdbdb-7855-4c2a-9596-a77a1c15681b service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:09.954236 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.compute.server_external_events [req-ff564032-2e6f-44cc-ae19-a5d117d87b12 req-2e3fdbdb-7855-4c2a-9596-a77a1c15681b service nova] Creating event network-changed:a4851ee9-cb6c-453e-b0ec-22dce2143857 for instance 577caa63-5dbe-4508-8004-488bd8d79ac7 on hv-cinder-85528 Aug 31 01:36:09.960392 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [req-ff564032-2e6f-44cc-ae19-a5d117d87b12 req-2e3fdbdb-7855-4c2a-9596-a77a1c15681b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031730 Aug 31 01:36:09.961250 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 505/1028] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:36:10.505855 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-9ae4c800-eb38-4fad-add4-b7fd5e9ba400 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:36:10.506465 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-9ae4c800-eb38-4fad-add4-b7fd5e9ba400 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: 577caa63-5dbe-4508-8004-488bd8d79ac7] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:36:10.512587 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9ae4c800-eb38-4fad-add4-b7fd5e9ba400 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:10.513107 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9ae4c800-eb38-4fad-add4-b7fd5e9ba400 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:10.513574 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9ae4c800-eb38-4fad-add4-b7fd5e9ba400 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:10.514262 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9ae4c800-eb38-4fad-add4-b7fd5e9ba400 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:10.514716 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9ae4c800-eb38-4fad-add4-b7fd5e9ba400 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:10.515138 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-9ae4c800-eb38-4fad-add4-b7fd5e9ba400 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:10.645485 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-9ae4c800-eb38-4fad-add4-b7fd5e9ba400 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:36:10.653122 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-9ae4c800-eb38-4fad-add4-b7fd5e9ba400 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/577caa63-5dbe-4508-8004-488bd8d79ac7" status: 200 len: 1267 microversion: 2.1 time: 0.151265 Aug 31 01:36:10.653681 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 524/1029] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:36:10 2022] GET /compute/v2.1/servers/577caa63-5dbe-4508-8004-488bd8d79ac7 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:36:11.674820 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-8c85eede-9727-4e23-b5c2-d815836682e0 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:36:11.675517 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-8c85eede-9727-4e23-b5c2-d815836682e0 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: 577caa63-5dbe-4508-8004-488bd8d79ac7] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:36:11.681797 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8c85eede-9727-4e23-b5c2-d815836682e0 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:11.682280 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8c85eede-9727-4e23-b5c2-d815836682e0 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:11.682717 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8c85eede-9727-4e23-b5c2-d815836682e0 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:11.683407 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8c85eede-9727-4e23-b5c2-d815836682e0 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:11.683859 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8c85eede-9727-4e23-b5c2-d815836682e0 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:11.684287 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-8c85eede-9727-4e23-b5c2-d815836682e0 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:11.814685 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-8c85eede-9727-4e23-b5c2-d815836682e0 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:36:11.822405 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-8c85eede-9727-4e23-b5c2-d815836682e0 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/577caa63-5dbe-4508-8004-488bd8d79ac7" status: 200 len: 1267 microversion: 2.1 time: 0.152027 Aug 31 01:36:11.822965 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 506/1030] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:36:11 2022] GET /compute/v2.1/servers/577caa63-5dbe-4508-8004-488bd8d79ac7 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:36:12.843552 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-aa26d7c1-0fa9-41cd-90a4-0dbb56a0ae45 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:36:12.844252 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-aa26d7c1-0fa9-41cd-90a4-0dbb56a0ae45 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: 577caa63-5dbe-4508-8004-488bd8d79ac7] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:36:12.851128 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-aa26d7c1-0fa9-41cd-90a4-0dbb56a0ae45 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:12.851620 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-aa26d7c1-0fa9-41cd-90a4-0dbb56a0ae45 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:12.852054 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-aa26d7c1-0fa9-41cd-90a4-0dbb56a0ae45 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:12.852784 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-aa26d7c1-0fa9-41cd-90a4-0dbb56a0ae45 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:12.853253 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-aa26d7c1-0fa9-41cd-90a4-0dbb56a0ae45 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:12.853678 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-aa26d7c1-0fa9-41cd-90a4-0dbb56a0ae45 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:12.982377 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-aa26d7c1-0fa9-41cd-90a4-0dbb56a0ae45 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:36:12.990726 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-aa26d7c1-0fa9-41cd-90a4-0dbb56a0ae45 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/577caa63-5dbe-4508-8004-488bd8d79ac7" status: 200 len: 1267 microversion: 2.1 time: 0.151167 Aug 31 01:36:12.991281 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 525/1031] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:36:12 2022] GET /compute/v2.1/servers/577caa63-5dbe-4508-8004-488bd8d79ac7 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:36:14.011356 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-68c13492-c3df-4e3b-ada3-1d3e6c5cc11e tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:36:14.012085 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-68c13492-c3df-4e3b-ada3-1d3e6c5cc11e tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: 577caa63-5dbe-4508-8004-488bd8d79ac7] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:36:14.019009 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-68c13492-c3df-4e3b-ada3-1d3e6c5cc11e tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:14.019490 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-68c13492-c3df-4e3b-ada3-1d3e6c5cc11e tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:14.019926 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-68c13492-c3df-4e3b-ada3-1d3e6c5cc11e tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:14.020611 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-68c13492-c3df-4e3b-ada3-1d3e6c5cc11e tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:14.021092 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-68c13492-c3df-4e3b-ada3-1d3e6c5cc11e tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:14.021516 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-68c13492-c3df-4e3b-ada3-1d3e6c5cc11e tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:14.152333 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-68c13492-c3df-4e3b-ada3-1d3e6c5cc11e tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:36:14.160712 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-68c13492-c3df-4e3b-ada3-1d3e6c5cc11e tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/577caa63-5dbe-4508-8004-488bd8d79ac7" status: 200 len: 1267 microversion: 2.1 time: 0.153208 Aug 31 01:36:14.161294 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 507/1032] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:36:14 2022] GET /compute/v2.1/servers/577caa63-5dbe-4508-8004-488bd8d79ac7 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:36:15.180862 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-3bc96529-b58a-4328-bfe1-4195008fd08f tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:36:15.181482 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-3bc96529-b58a-4328-bfe1-4195008fd08f tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: 577caa63-5dbe-4508-8004-488bd8d79ac7] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:36:15.187993 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3bc96529-b58a-4328-bfe1-4195008fd08f tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:15.188474 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3bc96529-b58a-4328-bfe1-4195008fd08f tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:15.188945 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3bc96529-b58a-4328-bfe1-4195008fd08f tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:15.189636 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3bc96529-b58a-4328-bfe1-4195008fd08f tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:15.190592 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3bc96529-b58a-4328-bfe1-4195008fd08f tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:15.191012 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-3bc96529-b58a-4328-bfe1-4195008fd08f tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:15.318425 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-3bc96529-b58a-4328-bfe1-4195008fd08f tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:36:15.326028 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-3bc96529-b58a-4328-bfe1-4195008fd08f tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/577caa63-5dbe-4508-8004-488bd8d79ac7" status: 200 len: 1267 microversion: 2.1 time: 0.149095 Aug 31 01:36:15.326591 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 526/1033] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:36:15 2022] GET /compute/v2.1/servers/577caa63-5dbe-4508-8004-488bd8d79ac7 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:36:16.347964 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-bc429a0e-9c00-4140-af10-a2e546752f65 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:36:16.348576 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-bc429a0e-9c00-4140-af10-a2e546752f65 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: 577caa63-5dbe-4508-8004-488bd8d79ac7] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:36:16.351014 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell0:SELECT=2 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:36:16.355772 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-bc429a0e-9c00-4140-af10-a2e546752f65 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:16.356257 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-bc429a0e-9c00-4140-af10-a2e546752f65 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:16.356696 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-bc429a0e-9c00-4140-af10-a2e546752f65 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:16.357453 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-bc429a0e-9c00-4140-af10-a2e546752f65 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:16.357908 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-bc429a0e-9c00-4140-af10-a2e546752f65 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:16.358328 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-bc429a0e-9c00-4140-af10-a2e546752f65 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:16.490683 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-bc429a0e-9c00-4140-af10-a2e546752f65 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:36:16.498407 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-bc429a0e-9c00-4140-af10-a2e546752f65 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/577caa63-5dbe-4508-8004-488bd8d79ac7" status: 200 len: 1267 microversion: 2.1 time: 0.155007 Aug 31 01:36:16.498974 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 508/1034] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:36:16 2022] GET /compute/v2.1/servers/577caa63-5dbe-4508-8004-488bd8d79ac7 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:36:17.519630 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-bc4167cb-4e22-4704-b97b-913c11038e6a tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:36:17.520254 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-bc4167cb-4e22-4704-b97b-913c11038e6a tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: 577caa63-5dbe-4508-8004-488bd8d79ac7] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:36:17.522267 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell0:SELECT=2 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:36:17.523102 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell0:SELECT=6 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:36:17.528335 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-bc4167cb-4e22-4704-b97b-913c11038e6a tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:17.528881 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-bc4167cb-4e22-4704-b97b-913c11038e6a tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:17.529325 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-bc4167cb-4e22-4704-b97b-913c11038e6a tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:17.530048 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-bc4167cb-4e22-4704-b97b-913c11038e6a tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:17.530503 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-bc4167cb-4e22-4704-b97b-913c11038e6a tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:17.530929 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-bc4167cb-4e22-4704-b97b-913c11038e6a tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:17.663037 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-bc4167cb-4e22-4704-b97b-913c11038e6a tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:36:17.670752 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-bc4167cb-4e22-4704-b97b-913c11038e6a tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/577caa63-5dbe-4508-8004-488bd8d79ac7" status: 200 len: 1267 microversion: 2.1 time: 0.155114 Aug 31 01:36:17.671335 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 527/1035] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:36:17 2022] GET /compute/v2.1/servers/577caa63-5dbe-4508-8004-488bd8d79ac7 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:36:18.691424 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-f5f0fa09-2360-4d2a-b475-8e1d28cf9106 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:36:18.692014 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-f5f0fa09-2360-4d2a-b475-8e1d28cf9106 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: 577caa63-5dbe-4508-8004-488bd8d79ac7] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:36:18.698487 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f5f0fa09-2360-4d2a-b475-8e1d28cf9106 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:18.699230 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f5f0fa09-2360-4d2a-b475-8e1d28cf9106 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:18.699701 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f5f0fa09-2360-4d2a-b475-8e1d28cf9106 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:18.700386 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f5f0fa09-2360-4d2a-b475-8e1d28cf9106 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:18.700863 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f5f0fa09-2360-4d2a-b475-8e1d28cf9106 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:18.701287 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-f5f0fa09-2360-4d2a-b475-8e1d28cf9106 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:18.830442 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-f5f0fa09-2360-4d2a-b475-8e1d28cf9106 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:36:18.839112 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-f5f0fa09-2360-4d2a-b475-8e1d28cf9106 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/577caa63-5dbe-4508-8004-488bd8d79ac7" status: 200 len: 1267 microversion: 2.1 time: 0.151614 Aug 31 01:36:18.842400 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 509/1036] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:36:18 2022] GET /compute/v2.1/servers/577caa63-5dbe-4508-8004-488bd8d79ac7 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:36:19.474487 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-3d9bac86-00a1-41da-9538-6bec2ebcb01d req-887130ba-b2c7-4e0e-955a-1f25268fe13b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "577caa63-5dbe-4508-8004-488bd8d79ac7", "name": "network-vif-plugged", "status": "completed", "tag": "a4851ee9-cb6c-453e-b0ec-22dce2143857"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:36:19.484430 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-3d9bac86-00a1-41da-9538-6bec2ebcb01d req-887130ba-b2c7-4e0e-955a-1f25268fe13b service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:19.484946 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-3d9bac86-00a1-41da-9538-6bec2ebcb01d req-887130ba-b2c7-4e0e-955a-1f25268fe13b service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:19.485397 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-3d9bac86-00a1-41da-9538-6bec2ebcb01d req-887130ba-b2c7-4e0e-955a-1f25268fe13b service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:19.496020 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-3d9bac86-00a1-41da-9538-6bec2ebcb01d req-887130ba-b2c7-4e0e-955a-1f25268fe13b service nova] Creating event network-vif-plugged:a4851ee9-cb6c-453e-b0ec-22dce2143857 for instance 577caa63-5dbe-4508-8004-488bd8d79ac7 on hv-cinder-85528 Aug 31 01:36:19.501114 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-3d9bac86-00a1-41da-9538-6bec2ebcb01d req-887130ba-b2c7-4e0e-955a-1f25268fe13b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030972 Aug 31 01:36:19.501689 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 528/1037] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:36:19.859454 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-eb9e0853-e3d3-452a-95a9-0bb3d96f777c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:36:19.864973 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-eb9e0853-e3d3-452a-95a9-0bb3d96f777c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: 577caa63-5dbe-4508-8004-488bd8d79ac7] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:36:19.866533 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-eb9e0853-e3d3-452a-95a9-0bb3d96f777c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:19.867016 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-eb9e0853-e3d3-452a-95a9-0bb3d96f777c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:19.867456 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-eb9e0853-e3d3-452a-95a9-0bb3d96f777c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:19.868157 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-eb9e0853-e3d3-452a-95a9-0bb3d96f777c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:19.868611 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-eb9e0853-e3d3-452a-95a9-0bb3d96f777c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:19.869094 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-eb9e0853-e3d3-452a-95a9-0bb3d96f777c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:20.004635 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-eb9e0853-e3d3-452a-95a9-0bb3d96f777c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:36:20.012229 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-eb9e0853-e3d3-452a-95a9-0bb3d96f777c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/577caa63-5dbe-4508-8004-488bd8d79ac7" status: 200 len: 1267 microversion: 2.1 time: 0.156753 Aug 31 01:36:20.012800 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 510/1038] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:36:19 2022] GET /compute/v2.1/servers/577caa63-5dbe-4508-8004-488bd8d79ac7 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:36:21.032747 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-e1c1f801-45e2-4aff-a8f8-8ccf8f8d4b18 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:36:21.033445 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-e1c1f801-45e2-4aff-a8f8-8ccf8f8d4b18 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: 577caa63-5dbe-4508-8004-488bd8d79ac7] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:36:21.039588 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e1c1f801-45e2-4aff-a8f8-8ccf8f8d4b18 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:21.040080 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e1c1f801-45e2-4aff-a8f8-8ccf8f8d4b18 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:21.040597 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e1c1f801-45e2-4aff-a8f8-8ccf8f8d4b18 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:21.041272 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e1c1f801-45e2-4aff-a8f8-8ccf8f8d4b18 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:21.041731 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e1c1f801-45e2-4aff-a8f8-8ccf8f8d4b18 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:21.042161 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-e1c1f801-45e2-4aff-a8f8-8ccf8f8d4b18 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:21.173343 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-e1c1f801-45e2-4aff-a8f8-8ccf8f8d4b18 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:36:21.182086 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-e1c1f801-45e2-4aff-a8f8-8ccf8f8d4b18 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/577caa63-5dbe-4508-8004-488bd8d79ac7" status: 200 len: 1454 microversion: 2.1 time: 0.154090 Aug 31 01:36:21.184498 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 529/1039] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:36:21 2022] GET /compute/v2.1/servers/577caa63-5dbe-4508-8004-488bd8d79ac7 => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:36:21.202673 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-025348ab-fb07-497b-b808-2ca032e942f2 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:36:21.203317 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-025348ab-fb07-497b-b808-2ca032e942f2 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: 577caa63-5dbe-4508-8004-488bd8d79ac7] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:36:21.210363 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-025348ab-fb07-497b-b808-2ca032e942f2 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:21.210840 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-025348ab-fb07-497b-b808-2ca032e942f2 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:21.211276 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-025348ab-fb07-497b-b808-2ca032e942f2 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:21.211960 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-025348ab-fb07-497b-b808-2ca032e942f2 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:21.212408 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-025348ab-fb07-497b-b808-2ca032e942f2 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:21.212875 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-025348ab-fb07-497b-b808-2ca032e942f2 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:21.345753 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-025348ab-fb07-497b-b808-2ca032e942f2 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:36:21.353567 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-025348ab-fb07-497b-b808-2ca032e942f2 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/577caa63-5dbe-4508-8004-488bd8d79ac7" status: 200 len: 1454 microversion: 2.1 time: 0.154808 Aug 31 01:36:21.354126 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 511/1040] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:36:21 2022] GET /compute/v2.1/servers/577caa63-5dbe-4508-8004-488bd8d79ac7 => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:36:23.251450 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-37927e6a-3d5c-4149-8309-c7ea0da29145 req-7bb01f9a-84b0-4ad5-bd8e-19d62a353886 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "577caa63-5dbe-4508-8004-488bd8d79ac7", "tag": "a4851ee9-cb6c-453e-b0ec-22dce2143857"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:36:23.261890 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-37927e6a-3d5c-4149-8309-c7ea0da29145 req-7bb01f9a-84b0-4ad5-bd8e-19d62a353886 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:23.262450 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-37927e6a-3d5c-4149-8309-c7ea0da29145 req-7bb01f9a-84b0-4ad5-bd8e-19d62a353886 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:23.262949 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-37927e6a-3d5c-4149-8309-c7ea0da29145 req-7bb01f9a-84b0-4ad5-bd8e-19d62a353886 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:23.273952 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-37927e6a-3d5c-4149-8309-c7ea0da29145 req-7bb01f9a-84b0-4ad5-bd8e-19d62a353886 service nova] Creating event network-changed:a4851ee9-cb6c-453e-b0ec-22dce2143857 for instance 577caa63-5dbe-4508-8004-488bd8d79ac7 on hv-cinder-85528 Aug 31 01:36:23.279080 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-37927e6a-3d5c-4149-8309-c7ea0da29145 req-7bb01f9a-84b0-4ad5-bd8e-19d62a353886 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031343 Aug 31 01:36:23.279684 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 530/1041] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:36:35.020400 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 01:36:35.021075 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-dc39eaa9-29a1-4aa0-a1a2-0f574e4708b1 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:36:35.021466 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Wed Aug 31 01:36:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Aug 31 01:36:35.021557 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-dc39eaa9-29a1-4aa0-a1a2-0f574e4708b1 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:36:35.021981 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:36:35.023587 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:36:35.027003 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 01:36:35.027138 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Wed Aug 31 01:36:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 (ip 10.222.0.20) !!! Aug 31 01:36:35.028435 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-b54751bd-6d59-4eb5-b2de-1a9bf9fa185a req-c67b5b42-ba33-4d39-9340-1ad281ff524e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a8fe146-0b7b-4588-b312-2a525c4ca249", "tag": "51e05401-efe1-4123-a876-e27cdccec893"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:36:35.028984 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_api:SELECT=26 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:36:35.029676 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell1:SELECT=58 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:36:35.042155 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-b54751bd-6d59-4eb5-b2de-1a9bf9fa185a req-c67b5b42-ba33-4d39-9340-1ad281ff524e service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:35.042784 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-b54751bd-6d59-4eb5-b2de-1a9bf9fa185a req-c67b5b42-ba33-4d39-9340-1ad281ff524e service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:35.043288 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-b54751bd-6d59-4eb5-b2de-1a9bf9fa185a req-c67b5b42-ba33-4d39-9340-1ad281ff524e service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:35.043431 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-dc39eaa9-29a1-4aa0-a1a2-0f574e4708b1 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:35.043850 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-dc39eaa9-29a1-4aa0-a1a2-0f574e4708b1 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:35.044287 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-dc39eaa9-29a1-4aa0-a1a2-0f574e4708b1 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:35.045076 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-dc39eaa9-29a1-4aa0-a1a2-0f574e4708b1 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:35.045532 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-dc39eaa9-29a1-4aa0-a1a2-0f574e4708b1 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:35.045958 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-dc39eaa9-29a1-4aa0-a1a2-0f574e4708b1 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:35.058902 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-b54751bd-6d59-4eb5-b2de-1a9bf9fa185a req-c67b5b42-ba33-4d39-9340-1ad281ff524e service nova] Creating event network-changed:51e05401-efe1-4123-a876-e27cdccec893 for instance 9a8fe146-0b7b-4588-b312-2a525c4ca249 on hv-cinder-85528 Aug 31 01:36:35.062215 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-b54751bd-6d59-4eb5-b2de-1a9bf9fa185a req-c67b5b42-ba33-4d39-9340-1ad281ff524e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043678 Aug 31 01:36:35.063157 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 531/1042] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:36:35.074774 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-dc39eaa9-29a1-4aa0-a1a2-0f574e4708b1 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Going to try to terminate instance {{(pid=121026) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 01:36:35.336055 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-dc39eaa9-29a1-4aa0-a1a2-0f574e4708b1 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 204 len: 0 microversion: 2.1 time: 0.319293 Aug 31 01:36:35.337198 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 512/1043] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 01:36:35 2022] DELETE /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 01:36:35.346491 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-0387d8fa-f5b6-414b-ab44-60647a0d0aa8 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:36:35.348927 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-0387d8fa-f5b6-414b-ab44-60647a0d0aa8 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:36:35.354791 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0387d8fa-f5b6-414b-ab44-60647a0d0aa8 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:35.355276 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0387d8fa-f5b6-414b-ab44-60647a0d0aa8 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:35.355704 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0387d8fa-f5b6-414b-ab44-60647a0d0aa8 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:35.356394 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0387d8fa-f5b6-414b-ab44-60647a0d0aa8 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:35.356870 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0387d8fa-f5b6-414b-ab44-60647a0d0aa8 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:35.357288 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-0387d8fa-f5b6-414b-ab44-60647a0d0aa8 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:35.495569 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-0387d8fa-f5b6-414b-ab44-60647a0d0aa8 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:36:35.503918 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-0387d8fa-f5b6-414b-ab44-60647a0d0aa8 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1569 microversion: 2.1 time: 0.162141 Aug 31 01:36:35.504506 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 532/1044] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:36:35 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:36:36.526380 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-1e6a18f1-77f4-48b0-aec1-f278e53f53d6 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:36:36.527115 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-1e6a18f1-77f4-48b0-aec1-f278e53f53d6 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:36:36.533618 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1e6a18f1-77f4-48b0-aec1-f278e53f53d6 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:36.534101 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1e6a18f1-77f4-48b0-aec1-f278e53f53d6 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:36.534531 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1e6a18f1-77f4-48b0-aec1-f278e53f53d6 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:36.535216 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1e6a18f1-77f4-48b0-aec1-f278e53f53d6 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:36.535671 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1e6a18f1-77f4-48b0-aec1-f278e53f53d6 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:36.536092 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1e6a18f1-77f4-48b0-aec1-f278e53f53d6 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:36.669588 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-1e6a18f1-77f4-48b0-aec1-f278e53f53d6 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:36:36.677451 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-1e6a18f1-77f4-48b0-aec1-f278e53f53d6 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1569 microversion: 2.1 time: 0.155334 Aug 31 01:36:36.678245 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 513/1045] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:36:36 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:36:37.413458 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-2f22be36-f3af-4842-9291-4aaddf0e6035 req-e50e91d1-9952-4e55-86be-cde9e10bbe01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a8fe146-0b7b-4588-b312-2a525c4ca249", "name": "network-vif-deleted", "tag": "51e05401-efe1-4123-a876-e27cdccec893"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:36:37.423456 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-2f22be36-f3af-4842-9291-4aaddf0e6035 req-e50e91d1-9952-4e55-86be-cde9e10bbe01 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:37.423939 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-2f22be36-f3af-4842-9291-4aaddf0e6035 req-e50e91d1-9952-4e55-86be-cde9e10bbe01 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:37.424375 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-2f22be36-f3af-4842-9291-4aaddf0e6035 req-e50e91d1-9952-4e55-86be-cde9e10bbe01 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:37.435834 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-2f22be36-f3af-4842-9291-4aaddf0e6035 req-e50e91d1-9952-4e55-86be-cde9e10bbe01 service nova] Creating event network-vif-deleted:51e05401-efe1-4123-a876-e27cdccec893 for instance 9a8fe146-0b7b-4588-b312-2a525c4ca249 on hv-cinder-85528 Aug 31 01:36:37.440638 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-2f22be36-f3af-4842-9291-4aaddf0e6035 req-e50e91d1-9952-4e55-86be-cde9e10bbe01 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031532 Aug 31 01:36:37.441283 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 533/1046] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:36:37.699377 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-562b2323-97aa-4343-b85b-599d0c4e42bf tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:36:37.699989 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-562b2323-97aa-4343-b85b-599d0c4e42bf tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:36:37.706954 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-562b2323-97aa-4343-b85b-599d0c4e42bf tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:37.707444 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-562b2323-97aa-4343-b85b-599d0c4e42bf tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:37.707876 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-562b2323-97aa-4343-b85b-599d0c4e42bf tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:37.708580 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-562b2323-97aa-4343-b85b-599d0c4e42bf tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:37.709137 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-562b2323-97aa-4343-b85b-599d0c4e42bf tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:37.709564 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-562b2323-97aa-4343-b85b-599d0c4e42bf tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:37.775473 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-562b2323-97aa-4343-b85b-599d0c4e42bf tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:36:37.783753 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-562b2323-97aa-4343-b85b-599d0c4e42bf tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1220 microversion: 2.1 time: 0.088254 Aug 31 01:36:37.792588 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 514/1047] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:36:37 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:36:38.806536 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-11bfe130-fa35-47c1-982c-947b26e6c865 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:36:38.807223 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-11bfe130-fa35-47c1-982c-947b26e6c865 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:36:38.813416 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-11bfe130-fa35-47c1-982c-947b26e6c865 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:38.813893 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-11bfe130-fa35-47c1-982c-947b26e6c865 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:38.814318 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-11bfe130-fa35-47c1-982c-947b26e6c865 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:38.814992 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-11bfe130-fa35-47c1-982c-947b26e6c865 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:38.815498 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-11bfe130-fa35-47c1-982c-947b26e6c865 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:38.815910 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-11bfe130-fa35-47c1-982c-947b26e6c865 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:38.850623 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-11bfe130-fa35-47c1-982c-947b26e6c865 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:38.851108 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-11bfe130-fa35-47c1-982c-947b26e6c865 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:38.851543 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-11bfe130-fa35-47c1-982c-947b26e6c865 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:38.851988 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.objects.instance [None req-11bfe130-fa35-47c1-982c-947b26e6c865 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lazy-loading 'fault' on Instance uuid 9a8fe146-0b7b-4588-b312-2a525c4ca249 {{(pid=121025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:36:38.896300 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-11bfe130-fa35-47c1-982c-947b26e6c865 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181421ac2d7b49d496cabfd6f205f203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d06f2d1e24f0e9072a7f43bb4925b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:36:38.905358 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-11bfe130-fa35-47c1-982c-947b26e6c865 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 200 len: 1225 microversion: 2.1 time: 0.103924 Aug 31 01:36:38.905935 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 534/1048] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:36:38 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:36:39.926697 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-117e02e0-3d38-4baa-b2dd-8f37cd9665c2 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:36:39.927314 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-117e02e0-3d38-4baa-b2dd-8f37cd9665c2 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] [instance: 9a8fe146-0b7b-4588-b312-2a525c4ca249] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:36:39.934239 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-117e02e0-3d38-4baa-b2dd-8f37cd9665c2 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:39.934725 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-117e02e0-3d38-4baa-b2dd-8f37cd9665c2 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:39.935162 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-117e02e0-3d38-4baa-b2dd-8f37cd9665c2 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:39.935853 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-117e02e0-3d38-4baa-b2dd-8f37cd9665c2 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:36:39.936309 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-117e02e0-3d38-4baa-b2dd-8f37cd9665c2 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:36:39.936754 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-117e02e0-3d38-4baa-b2dd-8f37cd9665c2 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:36:39.950703 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.wsgi [None req-117e02e0-3d38-4baa-b2dd-8f37cd9665c2 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] HTTP exception thrown: Instance 9a8fe146-0b7b-4588-b312-2a525c4ca249 could not be found. Aug 31 01:36:39.952344 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-117e02e0-3d38-4baa-b2dd-8f37cd9665c2 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Request method failure captured: Aug 31 01:36:39.952344 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: request: GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 HTTP/1.1 Aug 31 01:36:39.952344 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept: application/json Aug 31 01:36:39.952344 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept-Encoding: identity Aug 31 01:36:39.952344 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Connection: close Aug 31 01:36:39.952344 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Length: 0 Aug 31 01:36:39.952344 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Type: application/json Aug 31 01:36:39.952344 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Host: 10.222.0.20 Aug 31 01:36:39.952344 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Openstack-System-Scope: None Aug 31 01:36:39.952344 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: User-Agent: python-urllib3/1.26.12 Aug 31 01:36:39.952344 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Auth-Token: gAAAAABjDroYYr27oICEJIe8VZosOlSlt9IK35iPkJxEj7O4HjMxQwUVVynCYE63oAI9jsS8aHV-CJryxbY3E3ZE9WBuygQxFao5JVqeEwi5BQfjCwTWXv76q4zTdMqKUXBUZbrL5YTBSm1m0oHR9h4mGMZwUcLwaNf5xQIc5DIcjQNTjrkK5MA Aug 31 01:36:39.952344 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Id: None Aug 31 01:36:39.952344 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Name: None Aug 31 01:36:39.952344 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Identity-Status: Confirmed Aug 31 01:36:39.952344 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Is-Admin-Project: True Aug 31 01:36:39.952344 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Id: default Aug 31 01:36:39.952344 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Name: Default Aug 31 01:36:39.952344 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Id: 970d06f2d1e24f0e9072a7f43bb4925b Aug 31 01:36:39.952344 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Name: tempest-TestShelveInstance-458119299 Aug 31 01:36:39.952344 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Role: member,reader Aug 31 01:36:39.952344 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Roles: member,reader Aug 31 01:36:39.954170 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/970d06f2d1e24f0e9072a7f43bb4925b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_970d06f2d1e24f0e9072a7f43bb4925b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/970d06f2d1e24f0e9072a7f43bb4925b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/970d06f2d1e24f0e9072a7f43bb4925b"}]}] Aug 31 01:36:39.954170 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant: tempest-TestShelveInstance-458119299 Aug 31 01:36:39.954170 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Id: 970d06f2d1e24f0e9072a7f43bb4925b Aug 31 01:36:39.954170 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Name: tempest-TestShelveInstance-458119299 Aug 31 01:36:39.954170 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User: tempest-TestShelveInstance-458119299-project Aug 31 01:36:39.954170 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Id: default Aug 31 01:36:39.954170 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Name: Default Aug 31 01:36:39.954170 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Id: 181421ac2d7b49d496cabfd6f205f203 Aug 31 01:36:39.954170 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Name: tempest-TestShelveInstance-458119299-project Aug 31 01:36:39.954170 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: method: > Aug 31 01:36:39.954170 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: exception: Instance 9a8fe146-0b7b-4588-b312-2a525c4ca249 could not be found. Aug 31 01:36:39.954170 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: action_args: {'id': '9a8fe146-0b7b-4588-b312-2a525c4ca249'} Aug 31 01:36:39.955428 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:36:39.955428 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:36:39.955428 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:36:39.955428 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:36:39.955428 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:36:39.955428 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:36:39.955428 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:36:39.955428 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:36:39.955428 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:36:39.955428 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:36:39.955428 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a8fe146-0b7b-4588-b312-2a525c4ca249 could not be found. Aug 31 01:36:39.955428 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:36:39.955428 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:36:39.955428 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:36:39.955428 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:36:39.955428 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:36:39.955428 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:36:39.955428 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:36:39.955428 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:36:39.955428 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:36:39.957169 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:36:39.957169 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:36:39.957169 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:36:39.957169 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:36:39.957169 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:36:39.957169 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:36:39.957169 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:36:39.957169 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a8fe146-0b7b-4588-b312-2a525c4ca249 could not be found. Aug 31 01:36:39.957169 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:36:39.957169 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:36:39.957169 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:36:39.957169 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:36:39.957169 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:36:39.957169 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:36:39.957169 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:36:39.957169 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:36:39.957169 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a8fe146-0b7b-4588-b312-2a525c4ca249 could not be found. Aug 31 01:36:39.957169 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:36:39.958640 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-117e02e0-3d38-4baa-b2dd-8f37cd9665c2 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Returning 404 to user: Instance 9a8fe146-0b7b-4588-b312-2a525c4ca249 could not be found. {{(pid=121026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:36:39.958640 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-117e02e0-3d38-4baa-b2dd-8f37cd9665c2 tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249" status: 404 len: 111 microversion: 2.1 time: 0.030991 Aug 31 01:36:39.958640 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 515/1049] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:36:39 2022] GET /compute/v2.1/servers/9a8fe146-0b7b-4588-b312-2a525c4ca249 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:36:40.179509 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-39e5d6f3-7a21-4150-99fc-0d1f5d5e0cfe tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] Calling method '.version_select at 0x7f1fe1581430>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:36:40.260601 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-39e5d6f3-7a21-4150-99fc-0d1f5d5e0cfe tempest-TestShelveInstance-458119299 tempest-TestShelveInstance-458119299-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1817962812" status: 202 len: 0 microversion: 2.1 time: 0.085875 Aug 31 01:36:40.261285 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 535/1050] 10.222.0.20 () {58 vars in 1254 bytes} [Wed Aug 31 01:36:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1817962812 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 01:37:58.980359 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:37:58.981122 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:37:58.985347 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-a75ca455-9064-4f32-b58e-4798459e6b47 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1364425466", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1559894197", "security_groups": [{"name": "tempest-secgroup-smoke-1481444852"}], "block_device_mapping_v2": [{"uuid": "3d9e443d-ff6b-4a7f-9a25-c0fd807927ca", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1c20fdf4-c01e-4a42-bd98-933028a4956d"}]}} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:37:59.250524 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.network.neutron [None req-a75ca455-9064-4f32-b58e-4798459e6b47 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] validate_networks() for [('1c20fdf4-c01e-4a42-bd98-933028a4956d', None, None, None, None, None)] {{(pid=121026) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 01:37:59.688978 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.virt.hardware [None req-a75ca455-9064-4f32-b58e-4798459e6b47 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Flavor limits 0:0:0 {{(pid=121026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 01:37:59.689399 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.virt.hardware [None req-a75ca455-9064-4f32-b58e-4798459e6b47 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Image limits 0:0:0 {{(pid=121026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 01:37:59.690397 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.virt.hardware [None req-a75ca455-9064-4f32-b58e-4798459e6b47 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Flavor pref 0:0:0 {{(pid=121026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 01:37:59.690804 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.virt.hardware [None req-a75ca455-9064-4f32-b58e-4798459e6b47 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Image pref 0:0:0 {{(pid=121026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 01:37:59.691214 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.virt.hardware [None req-a75ca455-9064-4f32-b58e-4798459e6b47 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 01:37:59.699932 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a75ca455-9064-4f32-b58e-4798459e6b47 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:37:59.700416 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a75ca455-9064-4f32-b58e-4798459e6b47 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:37:59.700895 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a75ca455-9064-4f32-b58e-4798459e6b47 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:37:59.701652 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a75ca455-9064-4f32-b58e-4798459e6b47 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:37:59.702109 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a75ca455-9064-4f32-b58e-4798459e6b47 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:37:59.702533 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-a75ca455-9064-4f32-b58e-4798459e6b47 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:37:59.719745 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.quota [None req-a75ca455-9064-4f32-b58e-4798459e6b47 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Getting quotas for project 8a6177d84e534b358b475672f474f6df. Resources: {'instances', 'cores', 'ram'} {{(pid=121026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 01:37:59.723696 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.quota [None req-a75ca455-9064-4f32-b58e-4798459e6b47 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Getting quotas for user af97536937fb405198e1474fc134b493 and project 8a6177d84e534b358b475672f474f6df. Resources: {'instances', 'cores', 'ram'} {{(pid=121026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 01:37:59.779596 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-a75ca455-9064-4f32-b58e-4798459e6b47 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Going to run 1 instances... {{(pid=121026) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 01:37:59.781759 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-a75ca455-9064-4f32-b58e-4798459e6b47 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: 80754cfb-0313-4198-ab32-51594eae2f65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3d9e443d-ff6b-4a7f-9a25-c0fd807927ca',volume_size=None,volume_type=None)] {{(pid=121026) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 01:38:00.172732 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-a75ca455-9064-4f32-b58e-4798459e6b47 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.194094 Aug 31 01:38:00.173509 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 516/1051] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 31 01:37:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 1195 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 01:38:00.183157 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell1:SELECT=18 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:38:00.183910 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:38:00.188318 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-e7dfcbee-7b45-4862-8f46-4986762524dd tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:38:00.189582 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-e7dfcbee-7b45-4862-8f46-4986762524dd tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: 80754cfb-0313-4198-ab32-51594eae2f65] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:38:00.293879 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-e7dfcbee-7b45-4862-8f46-4986762524dd tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:38:00.302691 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-e7dfcbee-7b45-4862-8f46-4986762524dd tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/80754cfb-0313-4198-ab32-51594eae2f65" status: 200 len: 1095 microversion: 2.1 time: 0.121740 Aug 31 01:38:00.303249 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 536/1052] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:38:00 2022] GET /compute/v2.1/servers/80754cfb-0313-4198-ab32-51594eae2f65 => generated 1095 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:38:01.323551 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-6280e461-99a1-4038-89b9-97925a1a3917 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:38:01.324223 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-6280e461-99a1-4038-89b9-97925a1a3917 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: 80754cfb-0313-4198-ab32-51594eae2f65] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:38:01.331202 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6280e461-99a1-4038-89b9-97925a1a3917 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:38:01.334023 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6280e461-99a1-4038-89b9-97925a1a3917 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:38:01.334023 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6280e461-99a1-4038-89b9-97925a1a3917 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:38:01.334023 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6280e461-99a1-4038-89b9-97925a1a3917 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:38:01.334023 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6280e461-99a1-4038-89b9-97925a1a3917 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:38:01.334403 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6280e461-99a1-4038-89b9-97925a1a3917 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:38:01.394208 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-6280e461-99a1-4038-89b9-97925a1a3917 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:38:01.402264 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-6280e461-99a1-4038-89b9-97925a1a3917 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/80754cfb-0313-4198-ab32-51594eae2f65" status: 200 len: 1145 microversion: 2.1 time: 0.083116 Aug 31 01:38:01.402861 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 517/1053] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:38:01 2022] GET /compute/v2.1/servers/80754cfb-0313-4198-ab32-51594eae2f65 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:38:02.423121 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-4118a8df-5e7a-44c0-8db6-f5e3d4714485 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:38:02.423716 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-4118a8df-5e7a-44c0-8db6-f5e3d4714485 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: 80754cfb-0313-4198-ab32-51594eae2f65] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:38:02.430218 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4118a8df-5e7a-44c0-8db6-f5e3d4714485 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:38:02.430715 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4118a8df-5e7a-44c0-8db6-f5e3d4714485 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:38:02.431104 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4118a8df-5e7a-44c0-8db6-f5e3d4714485 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:38:02.431780 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4118a8df-5e7a-44c0-8db6-f5e3d4714485 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:38:02.432229 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4118a8df-5e7a-44c0-8db6-f5e3d4714485 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:38:02.432643 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-4118a8df-5e7a-44c0-8db6-f5e3d4714485 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:38:02.495088 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-4118a8df-5e7a-44c0-8db6-f5e3d4714485 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:38:02.503037 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-4118a8df-5e7a-44c0-8db6-f5e3d4714485 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/80754cfb-0313-4198-ab32-51594eae2f65" status: 200 len: 1211 microversion: 2.1 time: 0.083843 Aug 31 01:38:02.503831 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 537/1054] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:38:02 2022] GET /compute/v2.1/servers/80754cfb-0313-4198-ab32-51594eae2f65 => generated 1211 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:38:03.524389 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-b704a2ed-641d-4f94-b9d4-babf5d4560ab tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:38:03.525652 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-b704a2ed-641d-4f94-b9d4-babf5d4560ab tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: 80754cfb-0313-4198-ab32-51594eae2f65] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:38:03.532189 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b704a2ed-641d-4f94-b9d4-babf5d4560ab tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:38:03.532682 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b704a2ed-641d-4f94-b9d4-babf5d4560ab tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:38:03.533159 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b704a2ed-641d-4f94-b9d4-babf5d4560ab tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:38:03.534355 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b704a2ed-641d-4f94-b9d4-babf5d4560ab tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:38:03.534811 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b704a2ed-641d-4f94-b9d4-babf5d4560ab tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:38:03.535233 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b704a2ed-641d-4f94-b9d4-babf5d4560ab tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:38:03.681075 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-b704a2ed-641d-4f94-b9d4-babf5d4560ab tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:38:03.688692 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-b704a2ed-641d-4f94-b9d4-babf5d4560ab tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/80754cfb-0313-4198-ab32-51594eae2f65" status: 200 len: 1267 microversion: 2.1 time: 0.168530 Aug 31 01:38:03.689278 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 518/1055] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:38:03 2022] GET /compute/v2.1/servers/80754cfb-0313-4198-ab32-51594eae2f65 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:38:03.778757 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-ee7cbf37-3573-495a-8ee6-d198afd9bbb7 req-9ac01ed0-e4ca-4aee-93dd-22da2c73c588 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80754cfb-0313-4198-ab32-51594eae2f65", "tag": "5a3e43e2-9c3b-4349-ab0c-0651f16b7ab0"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:38:03.789140 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-ee7cbf37-3573-495a-8ee6-d198afd9bbb7 req-9ac01ed0-e4ca-4aee-93dd-22da2c73c588 service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:38:03.789621 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-ee7cbf37-3573-495a-8ee6-d198afd9bbb7 req-9ac01ed0-e4ca-4aee-93dd-22da2c73c588 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:38:03.790047 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-ee7cbf37-3573-495a-8ee6-d198afd9bbb7 req-9ac01ed0-e4ca-4aee-93dd-22da2c73c588 service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:38:03.801082 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-ee7cbf37-3573-495a-8ee6-d198afd9bbb7 req-9ac01ed0-e4ca-4aee-93dd-22da2c73c588 service nova] Creating event network-changed:5a3e43e2-9c3b-4349-ab0c-0651f16b7ab0 for instance 80754cfb-0313-4198-ab32-51594eae2f65 on hv-cinder-85528 Aug 31 01:38:03.806212 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-ee7cbf37-3573-495a-8ee6-d198afd9bbb7 req-9ac01ed0-e4ca-4aee-93dd-22da2c73c588 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031204 Aug 31 01:38:03.806882 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 538/1056] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:38:04.710352 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-6acd0f7f-7ffa-4050-81b8-b7dd9e9a4cc7 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:38:04.710961 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-6acd0f7f-7ffa-4050-81b8-b7dd9e9a4cc7 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: 80754cfb-0313-4198-ab32-51594eae2f65] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:38:04.717475 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6acd0f7f-7ffa-4050-81b8-b7dd9e9a4cc7 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:38:04.717899 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6acd0f7f-7ffa-4050-81b8-b7dd9e9a4cc7 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:38:04.718338 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6acd0f7f-7ffa-4050-81b8-b7dd9e9a4cc7 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:38:04.719025 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6acd0f7f-7ffa-4050-81b8-b7dd9e9a4cc7 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:38:04.719477 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6acd0f7f-7ffa-4050-81b8-b7dd9e9a4cc7 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:38:04.719901 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-6acd0f7f-7ffa-4050-81b8-b7dd9e9a4cc7 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:38:04.849118 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-6acd0f7f-7ffa-4050-81b8-b7dd9e9a4cc7 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:38:04.856746 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-6acd0f7f-7ffa-4050-81b8-b7dd9e9a4cc7 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/80754cfb-0313-4198-ab32-51594eae2f65" status: 200 len: 1267 microversion: 2.1 time: 0.150568 Aug 31 01:38:04.857326 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 519/1057] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:38:04 2022] GET /compute/v2.1/servers/80754cfb-0313-4198-ab32-51594eae2f65 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:38:05.878765 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-ee847ed4-88cc-4c19-94d7-8f376be36642 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:38:05.879475 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-ee847ed4-88cc-4c19-94d7-8f376be36642 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: 80754cfb-0313-4198-ab32-51594eae2f65] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:38:05.885681 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ee847ed4-88cc-4c19-94d7-8f376be36642 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:38:05.886169 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ee847ed4-88cc-4c19-94d7-8f376be36642 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:38:05.886610 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ee847ed4-88cc-4c19-94d7-8f376be36642 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:38:05.887299 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ee847ed4-88cc-4c19-94d7-8f376be36642 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:38:05.887754 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ee847ed4-88cc-4c19-94d7-8f376be36642 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:38:05.888176 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-ee847ed4-88cc-4c19-94d7-8f376be36642 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:38:06.021394 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-ee847ed4-88cc-4c19-94d7-8f376be36642 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:38:06.029117 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-ee847ed4-88cc-4c19-94d7-8f376be36642 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/80754cfb-0313-4198-ab32-51594eae2f65" status: 200 len: 1267 microversion: 2.1 time: 0.155464 Aug 31 01:38:06.029685 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 539/1058] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:38:05 2022] GET /compute/v2.1/servers/80754cfb-0313-4198-ab32-51594eae2f65 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:38:07.049645 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-5b42b3cd-1ef9-4921-81a4-4f1eb8f23cbd tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:38:07.050284 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-5b42b3cd-1ef9-4921-81a4-4f1eb8f23cbd tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: 80754cfb-0313-4198-ab32-51594eae2f65] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:38:07.056672 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5b42b3cd-1ef9-4921-81a4-4f1eb8f23cbd tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:38:07.057186 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5b42b3cd-1ef9-4921-81a4-4f1eb8f23cbd tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:38:07.057623 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5b42b3cd-1ef9-4921-81a4-4f1eb8f23cbd tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:38:07.058310 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5b42b3cd-1ef9-4921-81a4-4f1eb8f23cbd tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:38:07.058762 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5b42b3cd-1ef9-4921-81a4-4f1eb8f23cbd tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:38:07.059181 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-5b42b3cd-1ef9-4921-81a4-4f1eb8f23cbd tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:38:07.187057 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-5b42b3cd-1ef9-4921-81a4-4f1eb8f23cbd tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:38:07.195221 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-5b42b3cd-1ef9-4921-81a4-4f1eb8f23cbd tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/80754cfb-0313-4198-ab32-51594eae2f65" status: 200 len: 1267 microversion: 2.1 time: 0.149534 Aug 31 01:38:07.195786 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 520/1059] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:38:07 2022] GET /compute/v2.1/servers/80754cfb-0313-4198-ab32-51594eae2f65 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:38:08.216522 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-fbd5b697-7384-4a29-a488-22a583c6fd6c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:38:08.217159 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-fbd5b697-7384-4a29-a488-22a583c6fd6c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: 80754cfb-0313-4198-ab32-51594eae2f65] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:38:08.224139 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fbd5b697-7384-4a29-a488-22a583c6fd6c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:38:08.224624 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fbd5b697-7384-4a29-a488-22a583c6fd6c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:38:08.225085 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fbd5b697-7384-4a29-a488-22a583c6fd6c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:38:08.225773 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fbd5b697-7384-4a29-a488-22a583c6fd6c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:38:08.226225 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fbd5b697-7384-4a29-a488-22a583c6fd6c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:38:08.226650 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-fbd5b697-7384-4a29-a488-22a583c6fd6c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:38:08.358230 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-fbd5b697-7384-4a29-a488-22a583c6fd6c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:38:08.366083 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-fbd5b697-7384-4a29-a488-22a583c6fd6c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/80754cfb-0313-4198-ab32-51594eae2f65" status: 200 len: 1267 microversion: 2.1 time: 0.153361 Aug 31 01:38:08.366871 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 540/1060] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:38:08 2022] GET /compute/v2.1/servers/80754cfb-0313-4198-ab32-51594eae2f65 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:38:09.386540 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-2a22f7f1-2e13-4842-bb6b-7713e44ee33e tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:38:09.387142 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-2a22f7f1-2e13-4842-bb6b-7713e44ee33e tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: 80754cfb-0313-4198-ab32-51594eae2f65] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:38:09.393498 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-2a22f7f1-2e13-4842-bb6b-7713e44ee33e tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:38:09.393974 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-2a22f7f1-2e13-4842-bb6b-7713e44ee33e tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:38:09.394397 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-2a22f7f1-2e13-4842-bb6b-7713e44ee33e tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:38:09.395071 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-2a22f7f1-2e13-4842-bb6b-7713e44ee33e tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:38:09.395514 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-2a22f7f1-2e13-4842-bb6b-7713e44ee33e tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:38:09.395925 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-2a22f7f1-2e13-4842-bb6b-7713e44ee33e tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:38:09.526134 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-2a22f7f1-2e13-4842-bb6b-7713e44ee33e tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:38:09.534338 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-2a22f7f1-2e13-4842-bb6b-7713e44ee33e tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/80754cfb-0313-4198-ab32-51594eae2f65" status: 200 len: 1267 microversion: 2.1 time: 0.151779 Aug 31 01:38:09.534896 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 521/1061] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:38:09 2022] GET /compute/v2.1/servers/80754cfb-0313-4198-ab32-51594eae2f65 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:38:10.555793 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-526bd104-8c37-4542-a901-3f00b2be3cfd tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:38:10.556336 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-526bd104-8c37-4542-a901-3f00b2be3cfd tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: 80754cfb-0313-4198-ab32-51594eae2f65] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:38:10.558344 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell0:SELECT=2 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:38:10.563040 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-526bd104-8c37-4542-a901-3f00b2be3cfd tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:38:10.567895 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-526bd104-8c37-4542-a901-3f00b2be3cfd tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:38:10.567895 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-526bd104-8c37-4542-a901-3f00b2be3cfd tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:38:10.567895 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-526bd104-8c37-4542-a901-3f00b2be3cfd tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:38:10.567895 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-526bd104-8c37-4542-a901-3f00b2be3cfd tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:38:10.568308 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-526bd104-8c37-4542-a901-3f00b2be3cfd tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:38:10.694386 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-526bd104-8c37-4542-a901-3f00b2be3cfd tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:38:10.702096 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-526bd104-8c37-4542-a901-3f00b2be3cfd tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/80754cfb-0313-4198-ab32-51594eae2f65" status: 200 len: 1267 microversion: 2.1 time: 0.150447 Aug 31 01:38:10.702665 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 541/1062] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:38:10 2022] GET /compute/v2.1/servers/80754cfb-0313-4198-ab32-51594eae2f65 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:38:11.722539 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-68aa8880-535a-482a-9360-2a139bba33f1 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:38:11.723141 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-68aa8880-535a-482a-9360-2a139bba33f1 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: 80754cfb-0313-4198-ab32-51594eae2f65] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:38:11.725155 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell0:SELECT=2 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:38:11.725846 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell0:SELECT=6 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:38:11.730542 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-68aa8880-535a-482a-9360-2a139bba33f1 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:38:11.731024 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-68aa8880-535a-482a-9360-2a139bba33f1 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:38:11.731459 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-68aa8880-535a-482a-9360-2a139bba33f1 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:38:11.732141 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-68aa8880-535a-482a-9360-2a139bba33f1 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:38:11.732595 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-68aa8880-535a-482a-9360-2a139bba33f1 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:38:11.733065 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-68aa8880-535a-482a-9360-2a139bba33f1 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:38:12.144606 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-68aa8880-535a-482a-9360-2a139bba33f1 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:38:12.152308 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-68aa8880-535a-482a-9360-2a139bba33f1 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/80754cfb-0313-4198-ab32-51594eae2f65" status: 200 len: 1267 microversion: 2.1 time: 0.433671 Aug 31 01:38:12.152896 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 522/1063] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:38:11 2022] GET /compute/v2.1/servers/80754cfb-0313-4198-ab32-51594eae2f65 => generated 1267 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:38:13.172420 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-c103afe1-f3cb-435c-b5b7-696725ffd32f tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:38:13.173109 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-c103afe1-f3cb-435c-b5b7-696725ffd32f tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: 80754cfb-0313-4198-ab32-51594eae2f65] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:38:13.179784 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c103afe1-f3cb-435c-b5b7-696725ffd32f tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:38:13.185248 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c103afe1-f3cb-435c-b5b7-696725ffd32f tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:38:13.185248 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c103afe1-f3cb-435c-b5b7-696725ffd32f tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:38:13.185248 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c103afe1-f3cb-435c-b5b7-696725ffd32f tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:38:13.185248 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c103afe1-f3cb-435c-b5b7-696725ffd32f tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:38:13.185647 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-c103afe1-f3cb-435c-b5b7-696725ffd32f tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:38:13.310625 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-c103afe1-f3cb-435c-b5b7-696725ffd32f tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:38:13.318737 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-c103afe1-f3cb-435c-b5b7-696725ffd32f tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/80754cfb-0313-4198-ab32-51594eae2f65" status: 200 len: 1267 microversion: 2.1 time: 0.150235 Aug 31 01:38:13.319298 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 542/1064] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:38:13 2022] GET /compute/v2.1/servers/80754cfb-0313-4198-ab32-51594eae2f65 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:38:14.027189 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [req-927d5c28-c0b1-4140-97f2-23f78ec75d83 req-02e51e93-d58b-4c20-8218-218798e2fd5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80754cfb-0313-4198-ab32-51594eae2f65", "name": "network-vif-plugged", "status": "completed", "tag": "5a3e43e2-9c3b-4349-ab0c-0651f16b7ab0"}]} {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:38:14.037635 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-927d5c28-c0b1-4140-97f2-23f78ec75d83 req-02e51e93-d58b-4c20-8218-218798e2fd5d service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:38:14.038044 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-927d5c28-c0b1-4140-97f2-23f78ec75d83 req-02e51e93-d58b-4c20-8218-218798e2fd5d service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:38:14.038462 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [req-927d5c28-c0b1-4140-97f2-23f78ec75d83 req-02e51e93-d58b-4c20-8218-218798e2fd5d service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:38:14.049637 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.compute.server_external_events [req-927d5c28-c0b1-4140-97f2-23f78ec75d83 req-02e51e93-d58b-4c20-8218-218798e2fd5d service nova] Creating event network-vif-plugged:5a3e43e2-9c3b-4349-ab0c-0651f16b7ab0 for instance 80754cfb-0313-4198-ab32-51594eae2f65 on hv-cinder-85528 Aug 31 01:38:14.054703 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [req-927d5c28-c0b1-4140-97f2-23f78ec75d83 req-02e51e93-d58b-4c20-8218-218798e2fd5d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031303 Aug 31 01:38:14.055283 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 523/1065] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:38:14.339516 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-6a864462-2d3f-48a9-93bb-7e111ba9aa2f tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:38:14.340066 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-6a864462-2d3f-48a9-93bb-7e111ba9aa2f tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: 80754cfb-0313-4198-ab32-51594eae2f65] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:38:14.347064 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6a864462-2d3f-48a9-93bb-7e111ba9aa2f tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:38:14.348143 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6a864462-2d3f-48a9-93bb-7e111ba9aa2f tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:38:14.348143 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6a864462-2d3f-48a9-93bb-7e111ba9aa2f tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:38:14.348647 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6a864462-2d3f-48a9-93bb-7e111ba9aa2f tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:38:14.349132 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6a864462-2d3f-48a9-93bb-7e111ba9aa2f tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:38:14.349559 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6a864462-2d3f-48a9-93bb-7e111ba9aa2f tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:38:14.483497 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-6a864462-2d3f-48a9-93bb-7e111ba9aa2f tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:38:14.491123 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-6a864462-2d3f-48a9-93bb-7e111ba9aa2f tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/80754cfb-0313-4198-ab32-51594eae2f65" status: 200 len: 1267 microversion: 2.1 time: 0.155626 Aug 31 01:38:14.491687 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 543/1066] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:38:14 2022] GET /compute/v2.1/servers/80754cfb-0313-4198-ab32-51594eae2f65 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:38:15.512821 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-b4fb1aee-a981-426f-8a59-04840c39d5ad tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:38:15.513448 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-b4fb1aee-a981-426f-8a59-04840c39d5ad tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: 80754cfb-0313-4198-ab32-51594eae2f65] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:38:15.519739 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b4fb1aee-a981-426f-8a59-04840c39d5ad tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:38:15.520227 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b4fb1aee-a981-426f-8a59-04840c39d5ad tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:38:15.520663 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b4fb1aee-a981-426f-8a59-04840c39d5ad tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:38:15.521374 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b4fb1aee-a981-426f-8a59-04840c39d5ad tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:38:15.521851 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b4fb1aee-a981-426f-8a59-04840c39d5ad tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:38:15.522277 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-b4fb1aee-a981-426f-8a59-04840c39d5ad tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:38:15.653177 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-b4fb1aee-a981-426f-8a59-04840c39d5ad tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:38:15.661442 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-b4fb1aee-a981-426f-8a59-04840c39d5ad tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/80754cfb-0313-4198-ab32-51594eae2f65" status: 200 len: 1267 microversion: 2.1 time: 0.153776 Aug 31 01:38:15.662012 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 524/1067] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:38:15 2022] GET /compute/v2.1/servers/80754cfb-0313-4198-ab32-51594eae2f65 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:38:16.683004 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-2a36b40e-1419-413b-b08f-618dad06d4fc tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:38:16.683617 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-2a36b40e-1419-413b-b08f-618dad06d4fc tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: 80754cfb-0313-4198-ab32-51594eae2f65] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:38:16.691556 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2a36b40e-1419-413b-b08f-618dad06d4fc tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:38:16.692130 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2a36b40e-1419-413b-b08f-618dad06d4fc tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:38:16.692579 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2a36b40e-1419-413b-b08f-618dad06d4fc tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:38:16.693303 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2a36b40e-1419-413b-b08f-618dad06d4fc tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:38:16.693760 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2a36b40e-1419-413b-b08f-618dad06d4fc tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:38:16.694188 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2a36b40e-1419-413b-b08f-618dad06d4fc tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:38:16.823485 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-2a36b40e-1419-413b-b08f-618dad06d4fc tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:38:16.831392 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-2a36b40e-1419-413b-b08f-618dad06d4fc tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/80754cfb-0313-4198-ab32-51594eae2f65" status: 200 len: 1453 microversion: 2.1 time: 0.152337 Aug 31 01:38:16.831985 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 544/1068] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:38:16 2022] GET /compute/v2.1/servers/80754cfb-0313-4198-ab32-51594eae2f65 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:38:16.851520 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-19284086-974a-4369-926a-9e9ecf813614 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:38:16.852129 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-19284086-974a-4369-926a-9e9ecf813614 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: 80754cfb-0313-4198-ab32-51594eae2f65] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:38:16.858455 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-19284086-974a-4369-926a-9e9ecf813614 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:38:16.858933 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-19284086-974a-4369-926a-9e9ecf813614 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:38:16.859370 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-19284086-974a-4369-926a-9e9ecf813614 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:38:16.860052 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-19284086-974a-4369-926a-9e9ecf813614 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:38:16.860503 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-19284086-974a-4369-926a-9e9ecf813614 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:38:16.861551 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-19284086-974a-4369-926a-9e9ecf813614 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:38:16.991735 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-19284086-974a-4369-926a-9e9ecf813614 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:38:16.999393 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-19284086-974a-4369-926a-9e9ecf813614 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/80754cfb-0313-4198-ab32-51594eae2f65" status: 200 len: 1453 microversion: 2.1 time: 0.151685 Aug 31 01:38:16.999954 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 525/1069] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:38:16 2022] GET /compute/v2.1/servers/80754cfb-0313-4198-ab32-51594eae2f65 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:38:18.876334 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-50342a3c-8c42-4a5f-b5bf-4fc0fc5d4a2a req-e188b5cd-8156-4b21-a1bb-7272ec05015d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80754cfb-0313-4198-ab32-51594eae2f65", "tag": "5a3e43e2-9c3b-4349-ab0c-0651f16b7ab0"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:38:18.887216 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-50342a3c-8c42-4a5f-b5bf-4fc0fc5d4a2a req-e188b5cd-8156-4b21-a1bb-7272ec05015d service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:38:18.887704 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-50342a3c-8c42-4a5f-b5bf-4fc0fc5d4a2a req-e188b5cd-8156-4b21-a1bb-7272ec05015d service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:38:18.888142 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-50342a3c-8c42-4a5f-b5bf-4fc0fc5d4a2a req-e188b5cd-8156-4b21-a1bb-7272ec05015d service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:38:18.904592 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-50342a3c-8c42-4a5f-b5bf-4fc0fc5d4a2a req-e188b5cd-8156-4b21-a1bb-7272ec05015d service nova] Creating event network-changed:5a3e43e2-9c3b-4349-ab0c-0651f16b7ab0 for instance 80754cfb-0313-4198-ab32-51594eae2f65 on hv-cinder-85528 Aug 31 01:38:18.910360 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-50342a3c-8c42-4a5f-b5bf-4fc0fc5d4a2a req-e188b5cd-8156-4b21-a1bb-7272ec05015d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037853 Aug 31 01:38:18.911137 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 545/1070] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:39:47.049467 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-1d5f1d62-3975-4801-b783-436f6fb26bef tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:39:47.050018 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_api:SELECT=22 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:39:47.050392 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-1d5f1d62-3975-4801-b783-436f6fb26bef tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: 80754cfb-0313-4198-ab32-51594eae2f65] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:39:47.050493 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG dbcounter [-] [121025] Writing DB stats nova_cell1:SELECT=46 {{(pid=121025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:39:47.052596 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:39:47.053368 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG dbcounter [-] [121026] Writing DB stats nova_cell1:SELECT=52 {{(pid=121026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:39:47.054456 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 01:39:47.054606 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Wed Aug 31 01:39:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/80754cfb-0313-4198-ab32-51594eae2f65 (ip 10.222.0.20) !!! Aug 31 01:39:47.065502 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1d5f1d62-3975-4801-b783-436f6fb26bef tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:39:47.068023 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1d5f1d62-3975-4801-b783-436f6fb26bef tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:39:47.068023 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1d5f1d62-3975-4801-b783-436f6fb26bef tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:39:47.068023 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1d5f1d62-3975-4801-b783-436f6fb26bef tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:39:47.068023 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1d5f1d62-3975-4801-b783-436f6fb26bef tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:39:47.068381 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-1d5f1d62-3975-4801-b783-436f6fb26bef tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:39:47.109099 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-1d5f1d62-3975-4801-b783-436f6fb26bef tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: 80754cfb-0313-4198-ab32-51594eae2f65] Going to try to terminate instance {{(pid=121026) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 01:39:47.123796 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-bc01691d-1fd6-4c75-87ed-97573edc2421 req-fe999ff5-cfdf-428b-bf65-a84b175cb10b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80754cfb-0313-4198-ab32-51594eae2f65", "tag": "5a3e43e2-9c3b-4349-ab0c-0651f16b7ab0"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:39:47.133646 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-bc01691d-1fd6-4c75-87ed-97573edc2421 req-fe999ff5-cfdf-428b-bf65-a84b175cb10b service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:39:47.134192 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-bc01691d-1fd6-4c75-87ed-97573edc2421 req-fe999ff5-cfdf-428b-bf65-a84b175cb10b service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:39:47.134631 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-bc01691d-1fd6-4c75-87ed-97573edc2421 req-fe999ff5-cfdf-428b-bf65-a84b175cb10b service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:39:47.146478 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-bc01691d-1fd6-4c75-87ed-97573edc2421 req-fe999ff5-cfdf-428b-bf65-a84b175cb10b service nova] Creating event network-changed:5a3e43e2-9c3b-4349-ab0c-0651f16b7ab0 for instance 80754cfb-0313-4198-ab32-51594eae2f65 on hv-cinder-85528 Aug 31 01:39:47.152316 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-bc01691d-1fd6-4c75-87ed-97573edc2421 req-fe999ff5-cfdf-428b-bf65-a84b175cb10b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105033 Aug 31 01:39:47.153088 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 546/1071] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:39:47.412938 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-1d5f1d62-3975-4801-b783-436f6fb26bef tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "DELETE /compute/v2.1/servers/80754cfb-0313-4198-ab32-51594eae2f65" status: 204 len: 0 microversion: 2.1 time: 0.367936 Aug 31 01:39:47.413755 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 526/1072] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 01:39:47 2022] DELETE /compute/v2.1/servers/80754cfb-0313-4198-ab32-51594eae2f65 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 01:39:47.422342 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-963d3d4b-97e7-4cb1-ae27-38ec075e35d6 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:39:47.423384 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-963d3d4b-97e7-4cb1-ae27-38ec075e35d6 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: 80754cfb-0313-4198-ab32-51594eae2f65] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:39:47.430074 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-963d3d4b-97e7-4cb1-ae27-38ec075e35d6 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:39:47.430560 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-963d3d4b-97e7-4cb1-ae27-38ec075e35d6 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:39:47.430990 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-963d3d4b-97e7-4cb1-ae27-38ec075e35d6 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:39:47.431678 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-963d3d4b-97e7-4cb1-ae27-38ec075e35d6 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:39:47.432127 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-963d3d4b-97e7-4cb1-ae27-38ec075e35d6 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:39:47.432540 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-963d3d4b-97e7-4cb1-ae27-38ec075e35d6 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:39:47.596540 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-963d3d4b-97e7-4cb1-ae27-38ec075e35d6 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:39:47.604376 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-963d3d4b-97e7-4cb1-ae27-38ec075e35d6 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/80754cfb-0313-4198-ab32-51594eae2f65" status: 200 len: 1578 microversion: 2.1 time: 0.186246 Aug 31 01:39:47.605171 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 547/1073] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:39:47 2022] GET /compute/v2.1/servers/80754cfb-0313-4198-ab32-51594eae2f65 => generated 1578 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:39:48.626340 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-af412071-363f-4e13-adc5-8b6174b278b5 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:39:48.627047 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-af412071-363f-4e13-adc5-8b6174b278b5 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: 80754cfb-0313-4198-ab32-51594eae2f65] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:39:48.634015 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-af412071-363f-4e13-adc5-8b6174b278b5 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:39:48.634513 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-af412071-363f-4e13-adc5-8b6174b278b5 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:39:48.634952 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-af412071-363f-4e13-adc5-8b6174b278b5 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:39:48.635665 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-af412071-363f-4e13-adc5-8b6174b278b5 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:39:48.636125 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-af412071-363f-4e13-adc5-8b6174b278b5 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:39:48.636551 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-af412071-363f-4e13-adc5-8b6174b278b5 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:39:48.782375 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-af412071-363f-4e13-adc5-8b6174b278b5 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:39:48.790738 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-af412071-363f-4e13-adc5-8b6174b278b5 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/80754cfb-0313-4198-ab32-51594eae2f65" status: 200 len: 1578 microversion: 2.1 time: 0.168715 Aug 31 01:39:48.791313 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 527/1074] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:39:48 2022] GET /compute/v2.1/servers/80754cfb-0313-4198-ab32-51594eae2f65 => generated 1578 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:39:49.649437 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-69d3831b-c4b5-4750-b2ed-863c34fc7947 req-0502c216-6f0a-4178-bad4-92f1c2fd21fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80754cfb-0313-4198-ab32-51594eae2f65", "name": "network-vif-deleted", "tag": "5a3e43e2-9c3b-4349-ab0c-0651f16b7ab0"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:39:49.658999 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-69d3831b-c4b5-4750-b2ed-863c34fc7947 req-0502c216-6f0a-4178-bad4-92f1c2fd21fc service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:39:49.663371 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-69d3831b-c4b5-4750-b2ed-863c34fc7947 req-0502c216-6f0a-4178-bad4-92f1c2fd21fc service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:39:49.663371 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-69d3831b-c4b5-4750-b2ed-863c34fc7947 req-0502c216-6f0a-4178-bad4-92f1c2fd21fc service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:39:49.673260 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-69d3831b-c4b5-4750-b2ed-863c34fc7947 req-0502c216-6f0a-4178-bad4-92f1c2fd21fc service nova] Creating event network-vif-deleted:5a3e43e2-9c3b-4349-ab0c-0651f16b7ab0 for instance 80754cfb-0313-4198-ab32-51594eae2f65 on hv-cinder-85528 Aug 31 01:39:49.678102 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-69d3831b-c4b5-4750-b2ed-863c34fc7947 req-0502c216-6f0a-4178-bad4-92f1c2fd21fc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032395 Aug 31 01:39:49.678692 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 548/1075] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:39:49.811600 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-dc9625f9-98c1-4314-9b07-275d5c149472 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:39:49.812207 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-dc9625f9-98c1-4314-9b07-275d5c149472 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: 80754cfb-0313-4198-ab32-51594eae2f65] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:39:49.818583 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-dc9625f9-98c1-4314-9b07-275d5c149472 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:39:49.819003 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-dc9625f9-98c1-4314-9b07-275d5c149472 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:39:49.819436 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-dc9625f9-98c1-4314-9b07-275d5c149472 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:39:49.820188 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-dc9625f9-98c1-4314-9b07-275d5c149472 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:39:49.820634 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-dc9625f9-98c1-4314-9b07-275d5c149472 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:39:49.821074 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-dc9625f9-98c1-4314-9b07-275d5c149472 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:39:49.887969 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-dc9625f9-98c1-4314-9b07-275d5c149472 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:39:49.895716 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-dc9625f9-98c1-4314-9b07-275d5c149472 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/80754cfb-0313-4198-ab32-51594eae2f65" status: 200 len: 1226 microversion: 2.1 time: 0.088094 Aug 31 01:39:49.896497 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 528/1076] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:39:49 2022] GET /compute/v2.1/servers/80754cfb-0313-4198-ab32-51594eae2f65 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:39:50.917900 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-6eb2d1f0-ef19-4097-8ae6-4baf38e13b87 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:39:50.918603 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-6eb2d1f0-ef19-4097-8ae6-4baf38e13b87 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: 80754cfb-0313-4198-ab32-51594eae2f65] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:39:50.924740 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6eb2d1f0-ef19-4097-8ae6-4baf38e13b87 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:39:50.925232 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6eb2d1f0-ef19-4097-8ae6-4baf38e13b87 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:39:50.925668 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6eb2d1f0-ef19-4097-8ae6-4baf38e13b87 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:39:50.926359 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6eb2d1f0-ef19-4097-8ae6-4baf38e13b87 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:39:50.926810 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6eb2d1f0-ef19-4097-8ae6-4baf38e13b87 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:39:50.927233 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-6eb2d1f0-ef19-4097-8ae6-4baf38e13b87 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:39:50.940918 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.wsgi [None req-6eb2d1f0-ef19-4097-8ae6-4baf38e13b87 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] HTTP exception thrown: Instance 80754cfb-0313-4198-ab32-51594eae2f65 could not be found. Aug 31 01:39:50.943014 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-6eb2d1f0-ef19-4097-8ae6-4baf38e13b87 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Request method failure captured: Aug 31 01:39:50.943014 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: request: GET /compute/v2.1/servers/80754cfb-0313-4198-ab32-51594eae2f65 HTTP/1.1 Aug 31 01:39:50.943014 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept: application/json Aug 31 01:39:50.943014 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept-Encoding: identity Aug 31 01:39:50.943014 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Connection: close Aug 31 01:39:50.943014 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Length: 0 Aug 31 01:39:50.943014 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Type: application/json Aug 31 01:39:50.943014 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Host: 10.222.0.20 Aug 31 01:39:50.943014 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Openstack-System-Scope: None Aug 31 01:39:50.943014 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: User-Agent: python-urllib3/1.26.12 Aug 31 01:39:50.943014 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Auth-Token: gAAAAABjDrpiJGdXCI4jVMIXYsmScftUT7MJxM0vP5BowPrqnvdwid_cRehcrCvueRxHFkr4Nxd3gRgtS0w_ZG4Y5GC3KnWo43Lev3tBzfgdsKEF8rfhn7EAHBil0LqDyZWCvMJ3HKm-PDLBGvya_WTlE6e-o7NwfcMDXuOl3dxRGWYhIbDRyvE Aug 31 01:39:50.943014 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Id: None Aug 31 01:39:50.943014 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Name: None Aug 31 01:39:50.943014 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Identity-Status: Confirmed Aug 31 01:39:50.943014 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Is-Admin-Project: True Aug 31 01:39:50.943014 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Id: default Aug 31 01:39:50.943014 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Name: Default Aug 31 01:39:50.943014 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Id: 8a6177d84e534b358b475672f474f6df Aug 31 01:39:50.943014 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Name: tempest-TestVolumeBootPattern-1166927824 Aug 31 01:39:50.943014 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Role: member,reader Aug 31 01:39:50.943014 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Roles: member,reader Aug 31 01:39:50.944515 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8a6177d84e534b358b475672f474f6df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8a6177d84e534b358b475672f474f6df", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8a6177d84e534b358b475672f474f6df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8a6177d84e534b358b475672f474f6df"}]}] Aug 31 01:39:50.944515 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant: tempest-TestVolumeBootPattern-1166927824 Aug 31 01:39:50.944515 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Id: 8a6177d84e534b358b475672f474f6df Aug 31 01:39:50.944515 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Name: tempest-TestVolumeBootPattern-1166927824 Aug 31 01:39:50.944515 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User: tempest-TestVolumeBootPattern-1166927824-project Aug 31 01:39:50.944515 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Id: default Aug 31 01:39:50.944515 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Name: Default Aug 31 01:39:50.944515 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Id: af97536937fb405198e1474fc134b493 Aug 31 01:39:50.944515 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Name: tempest-TestVolumeBootPattern-1166927824-project Aug 31 01:39:50.944515 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: method: > Aug 31 01:39:50.944515 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: exception: Instance 80754cfb-0313-4198-ab32-51594eae2f65 could not be found. Aug 31 01:39:50.944515 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: action_args: {'id': '80754cfb-0313-4198-ab32-51594eae2f65'} Aug 31 01:39:50.946412 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:39:50.946412 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:39:50.946412 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:39:50.946412 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:39:50.946412 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:39:50.946412 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:39:50.946412 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:39:50.946412 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:39:50.946412 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:39:50.946412 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:39:50.946412 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80754cfb-0313-4198-ab32-51594eae2f65 could not be found. Aug 31 01:39:50.946412 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:39:50.946412 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:39:50.946412 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:39:50.946412 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:39:50.946412 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:39:50.946412 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:39:50.946412 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:39:50.946412 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:39:50.946412 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:39:50.948177 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:39:50.948177 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:39:50.948177 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:39:50.948177 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:39:50.948177 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:39:50.948177 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:39:50.948177 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:39:50.948177 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80754cfb-0313-4198-ab32-51594eae2f65 could not be found. Aug 31 01:39:50.948177 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:39:50.948177 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:39:50.948177 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:39:50.948177 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:39:50.948177 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:39:50.948177 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:39:50.948177 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:39:50.948177 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:39:50.948177 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80754cfb-0313-4198-ab32-51594eae2f65 could not be found. Aug 31 01:39:50.948177 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:39:50.949752 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-6eb2d1f0-ef19-4097-8ae6-4baf38e13b87 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Returning 404 to user: Instance 80754cfb-0313-4198-ab32-51594eae2f65 could not be found. {{(pid=121025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:39:50.949752 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-6eb2d1f0-ef19-4097-8ae6-4baf38e13b87 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/80754cfb-0313-4198-ab32-51594eae2f65" status: 404 len: 111 microversion: 2.1 time: 0.030729 Aug 31 01:39:50.949752 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 549/1077] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:39:50 2022] GET /compute/v2.1/servers/80754cfb-0313-4198-ab32-51594eae2f65 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:39:54.522824 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-ee051fe3-86c5-496e-982b-ef7094c43906 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:39:54.524031 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-ee051fe3-86c5-496e-982b-ef7094c43906 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: 577caa63-5dbe-4508-8004-488bd8d79ac7] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:39:54.525673 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-0f8f2f98-ab5c-4e5a-9411-20a21d05ca7d req-72163b78-c1ec-4365-a63c-1215863f281e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "577caa63-5dbe-4508-8004-488bd8d79ac7", "tag": "a4851ee9-cb6c-453e-b0ec-22dce2143857"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:39:54.530953 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ee051fe3-86c5-496e-982b-ef7094c43906 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:39:54.531518 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ee051fe3-86c5-496e-982b-ef7094c43906 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:39:54.532029 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ee051fe3-86c5-496e-982b-ef7094c43906 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:39:54.532842 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ee051fe3-86c5-496e-982b-ef7094c43906 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:39:54.533388 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ee051fe3-86c5-496e-982b-ef7094c43906 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:39:54.533991 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-ee051fe3-86c5-496e-982b-ef7094c43906 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:39:54.537354 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-0f8f2f98-ab5c-4e5a-9411-20a21d05ca7d req-72163b78-c1ec-4365-a63c-1215863f281e service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:39:54.537854 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-0f8f2f98-ab5c-4e5a-9411-20a21d05ca7d req-72163b78-c1ec-4365-a63c-1215863f281e service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:39:54.538544 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-0f8f2f98-ab5c-4e5a-9411-20a21d05ca7d req-72163b78-c1ec-4365-a63c-1215863f281e service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:39:54.554522 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-0f8f2f98-ab5c-4e5a-9411-20a21d05ca7d req-72163b78-c1ec-4365-a63c-1215863f281e service nova] Creating event network-changed:a4851ee9-cb6c-453e-b0ec-22dce2143857 for instance 577caa63-5dbe-4508-8004-488bd8d79ac7 on hv-cinder-85528 Aug 31 01:39:54.559753 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-0f8f2f98-ab5c-4e5a-9411-20a21d05ca7d req-72163b78-c1ec-4365-a63c-1215863f281e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038154 Aug 31 01:39:54.559960 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-ee051fe3-86c5-496e-982b-ef7094c43906 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: 577caa63-5dbe-4508-8004-488bd8d79ac7] Going to try to terminate instance {{(pid=121026) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 01:39:54.560686 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 550/1078] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:39:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:39:54.867257 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-ee051fe3-86c5-496e-982b-ef7094c43906 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "DELETE /compute/v2.1/servers/577caa63-5dbe-4508-8004-488bd8d79ac7" status: 204 len: 0 microversion: 2.1 time: 0.348027 Aug 31 01:39:54.868232 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 529/1079] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 01:39:54 2022] DELETE /compute/v2.1/servers/577caa63-5dbe-4508-8004-488bd8d79ac7 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 01:39:54.879165 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-419b9b18-a524-4656-805d-2ae48552bd24 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:39:54.879165 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-419b9b18-a524-4656-805d-2ae48552bd24 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: 577caa63-5dbe-4508-8004-488bd8d79ac7] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:39:54.885317 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-419b9b18-a524-4656-805d-2ae48552bd24 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:39:54.885802 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-419b9b18-a524-4656-805d-2ae48552bd24 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:39:54.886235 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-419b9b18-a524-4656-805d-2ae48552bd24 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:39:54.886931 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-419b9b18-a524-4656-805d-2ae48552bd24 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:39:54.887384 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-419b9b18-a524-4656-805d-2ae48552bd24 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:39:54.887792 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-419b9b18-a524-4656-805d-2ae48552bd24 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:39:55.066895 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.policy [None req-419b9b18-a524-4656-805d-2ae48552bd24 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121025) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:39:55.075236 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-419b9b18-a524-4656-805d-2ae48552bd24 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/577caa63-5dbe-4508-8004-488bd8d79ac7" status: 200 len: 1579 microversion: 2.1 time: 0.202569 Aug 31 01:39:55.075802 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 551/1080] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:39:54 2022] GET /compute/v2.1/servers/577caa63-5dbe-4508-8004-488bd8d79ac7 => generated 1579 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:39:56.097154 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-56aba31a-aae2-4b4e-9301-bd20bfdafe9a tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:39:56.097862 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-56aba31a-aae2-4b4e-9301-bd20bfdafe9a tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: 577caa63-5dbe-4508-8004-488bd8d79ac7] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:39:56.105583 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-56aba31a-aae2-4b4e-9301-bd20bfdafe9a tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:39:56.106068 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-56aba31a-aae2-4b4e-9301-bd20bfdafe9a tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:39:56.106509 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-56aba31a-aae2-4b4e-9301-bd20bfdafe9a tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:39:56.107200 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-56aba31a-aae2-4b4e-9301-bd20bfdafe9a tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:39:56.107658 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-56aba31a-aae2-4b4e-9301-bd20bfdafe9a tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:39:56.108082 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-56aba31a-aae2-4b4e-9301-bd20bfdafe9a tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:39:56.242721 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-56aba31a-aae2-4b4e-9301-bd20bfdafe9a tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:39:56.250441 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-56aba31a-aae2-4b4e-9301-bd20bfdafe9a tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/577caa63-5dbe-4508-8004-488bd8d79ac7" status: 200 len: 1579 microversion: 2.1 time: 0.157641 Aug 31 01:39:56.251007 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 530/1081] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:39:56 2022] GET /compute/v2.1/servers/577caa63-5dbe-4508-8004-488bd8d79ac7 => generated 1579 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:39:56.877185 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [req-554e88e3-95d7-4fff-ae49-a7f47882b61d req-e0312055-6dc2-4f01-80c0-687a7a4727cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "577caa63-5dbe-4508-8004-488bd8d79ac7", "name": "network-vif-deleted", "tag": "a4851ee9-cb6c-453e-b0ec-22dce2143857"}]} {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:39:56.883515 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 01:39:56.883667 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Wed Aug 31 01:39:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Aug 31 01:39:56.890379 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-554e88e3-95d7-4fff-ae49-a7f47882b61d req-e0312055-6dc2-4f01-80c0-687a7a4727cb service nova] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:39:56.890865 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-554e88e3-95d7-4fff-ae49-a7f47882b61d req-e0312055-6dc2-4f01-80c0-687a7a4727cb service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:39:56.891301 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [req-554e88e3-95d7-4fff-ae49-a7f47882b61d req-e0312055-6dc2-4f01-80c0-687a7a4727cb service nova] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:39:56.903096 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.compute.server_external_events [req-554e88e3-95d7-4fff-ae49-a7f47882b61d req-e0312055-6dc2-4f01-80c0-687a7a4727cb service nova] Creating event network-vif-deleted:a4851ee9-cb6c-453e-b0ec-22dce2143857 for instance 577caa63-5dbe-4508-8004-488bd8d79ac7 on hv-cinder-85528 Aug 31 01:39:56.907916 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [req-554e88e3-95d7-4fff-ae49-a7f47882b61d req-e0312055-6dc2-4f01-80c0-687a7a4727cb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034377 Aug 31 01:39:56.908515 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 552/1082] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 31 01:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:39:57.271608 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-e21f9546-f0fa-4145-8604-7a1caa27ea7e tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:39:57.274724 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-e21f9546-f0fa-4145-8604-7a1caa27ea7e tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: 577caa63-5dbe-4508-8004-488bd8d79ac7] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:39:57.279841 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e21f9546-f0fa-4145-8604-7a1caa27ea7e tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:39:57.280391 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e21f9546-f0fa-4145-8604-7a1caa27ea7e tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:39:57.280967 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e21f9546-f0fa-4145-8604-7a1caa27ea7e tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:39:57.281779 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e21f9546-f0fa-4145-8604-7a1caa27ea7e tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:39:57.282370 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e21f9546-f0fa-4145-8604-7a1caa27ea7e tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:39:57.282665 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-e21f9546-f0fa-4145-8604-7a1caa27ea7e tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:39:57.349417 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.policy [None req-e21f9546-f0fa-4145-8604-7a1caa27ea7e tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af97536937fb405198e1474fc134b493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6177d84e534b358b475672f474f6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121026) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:39:57.357779 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-e21f9546-f0fa-4145-8604-7a1caa27ea7e tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/577caa63-5dbe-4508-8004-488bd8d79ac7" status: 200 len: 1226 microversion: 2.1 time: 0.090070 Aug 31 01:39:57.358689 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 531/1083] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:39:57 2022] GET /compute/v2.1/servers/577caa63-5dbe-4508-8004-488bd8d79ac7 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:39:58.379829 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-2ed0311a-e9b1-4911-b488-d4e44bf677fb tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:39:58.380531 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-2ed0311a-e9b1-4911-b488-d4e44bf677fb tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: 577caa63-5dbe-4508-8004-488bd8d79ac7] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:39:58.387302 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2ed0311a-e9b1-4911-b488-d4e44bf677fb tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:39:58.387795 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2ed0311a-e9b1-4911-b488-d4e44bf677fb tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:39:58.388234 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2ed0311a-e9b1-4911-b488-d4e44bf677fb tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:39:58.388962 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2ed0311a-e9b1-4911-b488-d4e44bf677fb tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:39:58.389421 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2ed0311a-e9b1-4911-b488-d4e44bf677fb tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:39:58.389846 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-2ed0311a-e9b1-4911-b488-d4e44bf677fb tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:39:58.402946 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.wsgi [None req-2ed0311a-e9b1-4911-b488-d4e44bf677fb tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] HTTP exception thrown: Instance 577caa63-5dbe-4508-8004-488bd8d79ac7 could not be found. Aug 31 01:39:58.404548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-2ed0311a-e9b1-4911-b488-d4e44bf677fb tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Request method failure captured: Aug 31 01:39:58.404548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: request: GET /compute/v2.1/servers/577caa63-5dbe-4508-8004-488bd8d79ac7 HTTP/1.1 Aug 31 01:39:58.404548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept: application/json Aug 31 01:39:58.404548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept-Encoding: identity Aug 31 01:39:58.404548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Connection: close Aug 31 01:39:58.404548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Length: 0 Aug 31 01:39:58.404548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Type: application/json Aug 31 01:39:58.404548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Host: 10.222.0.20 Aug 31 01:39:58.404548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Openstack-System-Scope: None Aug 31 01:39:58.404548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: User-Agent: python-urllib3/1.26.12 Aug 31 01:39:58.404548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Auth-Token: gAAAAABjDrpiJGdXCI4jVMIXYsmScftUT7MJxM0vP5BowPrqnvdwid_cRehcrCvueRxHFkr4Nxd3gRgtS0w_ZG4Y5GC3KnWo43Lev3tBzfgdsKEF8rfhn7EAHBil0LqDyZWCvMJ3HKm-PDLBGvya_WTlE6e-o7NwfcMDXuOl3dxRGWYhIbDRyvE Aug 31 01:39:58.404548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Id: None Aug 31 01:39:58.404548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Name: None Aug 31 01:39:58.404548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Identity-Status: Confirmed Aug 31 01:39:58.404548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Is-Admin-Project: True Aug 31 01:39:58.404548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Id: default Aug 31 01:39:58.404548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Name: Default Aug 31 01:39:58.404548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Id: 8a6177d84e534b358b475672f474f6df Aug 31 01:39:58.404548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Name: tempest-TestVolumeBootPattern-1166927824 Aug 31 01:39:58.404548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Role: member,reader Aug 31 01:39:58.404548 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Roles: member,reader Aug 31 01:39:58.406342 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8a6177d84e534b358b475672f474f6df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8a6177d84e534b358b475672f474f6df", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8a6177d84e534b358b475672f474f6df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8a6177d84e534b358b475672f474f6df"}]}] Aug 31 01:39:58.406342 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant: tempest-TestVolumeBootPattern-1166927824 Aug 31 01:39:58.406342 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Id: 8a6177d84e534b358b475672f474f6df Aug 31 01:39:58.406342 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Name: tempest-TestVolumeBootPattern-1166927824 Aug 31 01:39:58.406342 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User: tempest-TestVolumeBootPattern-1166927824-project Aug 31 01:39:58.406342 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Id: default Aug 31 01:39:58.406342 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Name: Default Aug 31 01:39:58.406342 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Id: af97536937fb405198e1474fc134b493 Aug 31 01:39:58.406342 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Name: tempest-TestVolumeBootPattern-1166927824-project Aug 31 01:39:58.406342 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: method: > Aug 31 01:39:58.406342 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: exception: Instance 577caa63-5dbe-4508-8004-488bd8d79ac7 could not be found. Aug 31 01:39:58.406342 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: action_args: {'id': '577caa63-5dbe-4508-8004-488bd8d79ac7'} Aug 31 01:39:58.407560 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:39:58.407560 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:39:58.407560 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:39:58.407560 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:39:58.407560 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:39:58.407560 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:39:58.407560 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:39:58.407560 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:39:58.407560 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:39:58.407560 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:39:58.407560 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 577caa63-5dbe-4508-8004-488bd8d79ac7 could not be found. Aug 31 01:39:58.407560 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:39:58.407560 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:39:58.407560 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:39:58.407560 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:39:58.407560 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:39:58.407560 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:39:58.407560 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:39:58.407560 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:39:58.407560 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:39:58.409275 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:39:58.409275 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:39:58.409275 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:39:58.409275 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:39:58.409275 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:39:58.409275 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:39:58.409275 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:39:58.409275 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 577caa63-5dbe-4508-8004-488bd8d79ac7 could not be found. Aug 31 01:39:58.409275 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:39:58.409275 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:39:58.409275 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:39:58.409275 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:39:58.409275 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:39:58.409275 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:39:58.409275 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:39:58.409275 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:39:58.409275 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 577caa63-5dbe-4508-8004-488bd8d79ac7 could not be found. Aug 31 01:39:58.409275 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:39:58.410898 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-2ed0311a-e9b1-4911-b488-d4e44bf677fb tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Returning 404 to user: Instance 577caa63-5dbe-4508-8004-488bd8d79ac7 could not be found. {{(pid=121025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:39:58.410898 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-2ed0311a-e9b1-4911-b488-d4e44bf677fb tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/577caa63-5dbe-4508-8004-488bd8d79ac7" status: 404 len: 111 microversion: 2.1 time: 0.030955 Aug 31 01:39:58.410898 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 553/1084] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:39:58 2022] GET /compute/v2.1/servers/577caa63-5dbe-4508-8004-488bd8d79ac7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:39:58.903398 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-abafa2fa-6357-4c51-aaff-d8f93d44a73c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:39:58.903933 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.compute.api [None req-abafa2fa-6357-4c51-aaff-d8f93d44a73c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: e78060b8-25a5-43e3-8deb-d59bd2b3bae6] Fetching instance by UUID {{(pid=121026) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:39:58.910688 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-abafa2fa-6357-4c51-aaff-d8f93d44a73c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:39:58.911117 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-abafa2fa-6357-4c51-aaff-d8f93d44a73c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:39:58.911559 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-abafa2fa-6357-4c51-aaff-d8f93d44a73c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:39:58.912260 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-abafa2fa-6357-4c51-aaff-d8f93d44a73c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:39:58.912716 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-abafa2fa-6357-4c51-aaff-d8f93d44a73c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:39:58.913170 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG oslo_concurrency.lockutils [None req-abafa2fa-6357-4c51-aaff-d8f93d44a73c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:39:58.926961 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.wsgi [None req-abafa2fa-6357-4c51-aaff-d8f93d44a73c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] HTTP exception thrown: Instance e78060b8-25a5-43e3-8deb-d59bd2b3bae6 could not be found. Aug 31 01:39:58.928615 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-abafa2fa-6357-4c51-aaff-d8f93d44a73c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Request method failure captured: Aug 31 01:39:58.928615 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: request: DELETE /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6 HTTP/1.1 Aug 31 01:39:58.928615 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept: application/json Aug 31 01:39:58.928615 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Accept-Encoding: identity Aug 31 01:39:58.928615 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Connection: close Aug 31 01:39:58.928615 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Length: 0 Aug 31 01:39:58.928615 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Content-Type: application/json Aug 31 01:39:58.928615 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Host: 10.222.0.20 Aug 31 01:39:58.928615 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: Openstack-System-Scope: None Aug 31 01:39:58.928615 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: User-Agent: python-urllib3/1.26.12 Aug 31 01:39:58.928615 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Auth-Token: gAAAAABjDrpiJGdXCI4jVMIXYsmScftUT7MJxM0vP5BowPrqnvdwid_cRehcrCvueRxHFkr4Nxd3gRgtS0w_ZG4Y5GC3KnWo43Lev3tBzfgdsKEF8rfhn7EAHBil0LqDyZWCvMJ3HKm-PDLBGvya_WTlE6e-o7NwfcMDXuOl3dxRGWYhIbDRyvE Aug 31 01:39:58.928615 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Id: None Aug 31 01:39:58.928615 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Domain-Name: None Aug 31 01:39:58.928615 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Identity-Status: Confirmed Aug 31 01:39:58.928615 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Is-Admin-Project: True Aug 31 01:39:58.928615 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Id: default Aug 31 01:39:58.928615 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Domain-Name: Default Aug 31 01:39:58.928615 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Id: 8a6177d84e534b358b475672f474f6df Aug 31 01:39:58.928615 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Project-Name: tempest-TestVolumeBootPattern-1166927824 Aug 31 01:39:58.928615 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Role: member,reader Aug 31 01:39:58.928615 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Roles: member,reader Aug 31 01:39:58.930367 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8a6177d84e534b358b475672f474f6df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8a6177d84e534b358b475672f474f6df", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8a6177d84e534b358b475672f474f6df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8a6177d84e534b358b475672f474f6df"}]}] Aug 31 01:39:58.930367 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant: tempest-TestVolumeBootPattern-1166927824 Aug 31 01:39:58.930367 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Id: 8a6177d84e534b358b475672f474f6df Aug 31 01:39:58.930367 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-Tenant-Name: tempest-TestVolumeBootPattern-1166927824 Aug 31 01:39:58.930367 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User: tempest-TestVolumeBootPattern-1166927824-project Aug 31 01:39:58.930367 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Id: default Aug 31 01:39:58.930367 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Domain-Name: Default Aug 31 01:39:58.930367 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Id: af97536937fb405198e1474fc134b493 Aug 31 01:39:58.930367 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: X-User-Name: tempest-TestVolumeBootPattern-1166927824-project Aug 31 01:39:58.930367 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: method: > Aug 31 01:39:58.930367 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: exception: Instance e78060b8-25a5-43e3-8deb-d59bd2b3bae6 could not be found. Aug 31 01:39:58.930367 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: action_args: {'id': 'e78060b8-25a5-43e3-8deb-d59bd2b3bae6'} Aug 31 01:39:58.931226 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:39:58.931226 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:39:58.931226 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:39:58.931226 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:39:58.931226 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:39:58.931226 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:39:58.931226 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:39:58.931226 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:39:58.931226 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:39:58.931226 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:39:58.931226 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e78060b8-25a5-43e3-8deb-d59bd2b3bae6 could not be found. Aug 31 01:39:58.931226 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:39:58.931226 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:39:58.931226 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:39:58.931226 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:39:58.931226 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:39:58.931226 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:39:58.931226 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:39:58.931226 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:39:58.931226 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:39:58.932569 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:39:58.932569 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 01:39:58.932569 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 01:39:58.932569 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 01:39:58.932569 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 01:39:58.932569 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:39:58.932569 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:39:58.932569 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:39:58.932569 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:39:58.932569 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e78060b8-25a5-43e3-8deb-d59bd2b3bae6 could not be found. Aug 31 01:39:58.932569 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:39:58.932569 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:39:58.932569 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:39:58.932569 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:39:58.932569 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:39:58.932569 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:39:58.932569 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:39:58.932569 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:39:58.932569 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e78060b8-25a5-43e3-8deb-d59bd2b3bae6 could not be found. Aug 31 01:39:58.932569 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: ERROR nova.api.openstack.wsgi Aug 31 01:39:58.934014 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-abafa2fa-6357-4c51-aaff-d8f93d44a73c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Returning 404 to user: Instance e78060b8-25a5-43e3-8deb-d59bd2b3bae6 could not be found. {{(pid=121026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:39:58.934014 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-abafa2fa-6357-4c51-aaff-d8f93d44a73c tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6" status: 404 len: 111 microversion: 2.1 time: 0.030728 Aug 31 01:39:58.934014 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 532/1085] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 31 01:39:58 2022] DELETE /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:39:58.938595 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-bac0b9f0-4e24-4c76-8c60-823b39e6c2d2 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '>' {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:39:58.939207 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.compute.api [None req-bac0b9f0-4e24-4c76-8c60-823b39e6c2d2 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] [instance: e78060b8-25a5-43e3-8deb-d59bd2b3bae6] Fetching instance by UUID {{(pid=121025) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:39:58.945726 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-bac0b9f0-4e24-4c76-8c60-823b39e6c2d2 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:39:58.946564 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-bac0b9f0-4e24-4c76-8c60-823b39e6c2d2 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:39:58.947085 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-bac0b9f0-4e24-4c76-8c60-823b39e6c2d2 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:39:58.948106 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-bac0b9f0-4e24-4c76-8c60-823b39e6c2d2 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Acquiring lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:39:58.948681 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-bac0b9f0-4e24-4c76-8c60-823b39e6c2d2 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:39:58.949211 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG oslo_concurrency.lockutils [None req-bac0b9f0-4e24-4c76-8c60-823b39e6c2d2 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Lock "3ae4fc1d-5a8c-43c9-ac0a-1335d8c241e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:39:58.963453 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.wsgi [None req-bac0b9f0-4e24-4c76-8c60-823b39e6c2d2 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] HTTP exception thrown: Instance e78060b8-25a5-43e3-8deb-d59bd2b3bae6 could not be found. Aug 31 01:39:58.965000 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-bac0b9f0-4e24-4c76-8c60-823b39e6c2d2 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Request method failure captured: Aug 31 01:39:58.965000 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: request: GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6 HTTP/1.1 Aug 31 01:39:58.965000 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept: application/json Aug 31 01:39:58.965000 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Accept-Encoding: identity Aug 31 01:39:58.965000 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Connection: close Aug 31 01:39:58.965000 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Length: 0 Aug 31 01:39:58.965000 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Content-Type: application/json Aug 31 01:39:58.965000 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Host: 10.222.0.20 Aug 31 01:39:58.965000 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: Openstack-System-Scope: None Aug 31 01:39:58.965000 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: User-Agent: python-urllib3/1.26.12 Aug 31 01:39:58.965000 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Auth-Token: gAAAAABjDrpiJGdXCI4jVMIXYsmScftUT7MJxM0vP5BowPrqnvdwid_cRehcrCvueRxHFkr4Nxd3gRgtS0w_ZG4Y5GC3KnWo43Lev3tBzfgdsKEF8rfhn7EAHBil0LqDyZWCvMJ3HKm-PDLBGvya_WTlE6e-o7NwfcMDXuOl3dxRGWYhIbDRyvE Aug 31 01:39:58.965000 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Id: None Aug 31 01:39:58.965000 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Domain-Name: None Aug 31 01:39:58.965000 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Identity-Status: Confirmed Aug 31 01:39:58.965000 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Is-Admin-Project: True Aug 31 01:39:58.965000 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Id: default Aug 31 01:39:58.965000 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Domain-Name: Default Aug 31 01:39:58.965000 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Id: 8a6177d84e534b358b475672f474f6df Aug 31 01:39:58.965000 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Project-Name: tempest-TestVolumeBootPattern-1166927824 Aug 31 01:39:58.965000 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Role: member,reader Aug 31 01:39:58.965000 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Roles: member,reader Aug 31 01:39:58.966842 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8a6177d84e534b358b475672f474f6df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8a6177d84e534b358b475672f474f6df", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8a6177d84e534b358b475672f474f6df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8a6177d84e534b358b475672f474f6df"}]}] Aug 31 01:39:58.966842 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant: tempest-TestVolumeBootPattern-1166927824 Aug 31 01:39:58.966842 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Id: 8a6177d84e534b358b475672f474f6df Aug 31 01:39:58.966842 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-Tenant-Name: tempest-TestVolumeBootPattern-1166927824 Aug 31 01:39:58.966842 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User: tempest-TestVolumeBootPattern-1166927824-project Aug 31 01:39:58.966842 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Id: default Aug 31 01:39:58.966842 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Domain-Name: Default Aug 31 01:39:58.966842 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Id: af97536937fb405198e1474fc134b493 Aug 31 01:39:58.966842 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: X-User-Name: tempest-TestVolumeBootPattern-1166927824-project Aug 31 01:39:58.966842 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: method: > Aug 31 01:39:58.966842 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: exception: Instance e78060b8-25a5-43e3-8deb-d59bd2b3bae6 could not be found. Aug 31 01:39:58.966842 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: action_args: {'id': 'e78060b8-25a5-43e3-8deb-d59bd2b3bae6'} Aug 31 01:39:58.967812 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: {{(pid=121025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:39:58.967812 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:39:58.967812 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:39:58.967812 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:39:58.967812 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:39:58.967812 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:39:58.967812 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:39:58.967812 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:39:58.967812 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:39:58.967812 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:39:58.967812 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e78060b8-25a5-43e3-8deb-d59bd2b3bae6 could not be found. Aug 31 01:39:58.967812 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:39:58.967812 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:39:58.967812 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:39:58.967812 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:39:58.967812 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:39:58.967812 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:39:58.967812 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:39:58.967812 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:39:58.967812 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:39:58.969478 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:39:58.969478 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:39:58.969478 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:39:58.969478 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:39:58.969478 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:39:58.969478 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:39:58.969478 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:39:58.969478 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e78060b8-25a5-43e3-8deb-d59bd2b3bae6 could not be found. Aug 31 01:39:58.969478 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:39:58.969478 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:39:58.969478 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:39:58.969478 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:39:58.969478 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:39:58.969478 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:39:58.969478 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:39:58.969478 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:39:58.969478 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e78060b8-25a5-43e3-8deb-d59bd2b3bae6 could not be found. Aug 31 01:39:58.969478 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: ERROR nova.api.openstack.wsgi Aug 31 01:39:58.970878 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: DEBUG nova.api.openstack.wsgi [None req-bac0b9f0-4e24-4c76-8c60-823b39e6c2d2 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Returning 404 to user: Instance e78060b8-25a5-43e3-8deb-d59bd2b3bae6 could not be found. {{(pid=121025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:39:58.970878 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: INFO nova.api.openstack.requestlog [None req-bac0b9f0-4e24-4c76-8c60-823b39e6c2d2 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6" status: 404 len: 111 microversion: 2.1 time: 0.031716 Aug 31 01:39:58.970878 dv-cinder-855288-2-iscsi devstack@n-api.service[121025]: [pid: 121025|app: 0|req: 554/1086] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 31 01:39:58 2022] GET /compute/v2.1/servers/e78060b8-25a5-43e3-8deb-d59bd2b3bae6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 01:40:00.428390 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: DEBUG nova.api.openstack.wsgi [None req-e38bf091-8fb7-4358-b83b-625887199088 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] Calling method '.version_select at 0x7f1fe1b493a0>' {{(pid=121026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:40:00.516221 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: INFO nova.api.openstack.requestlog [None req-e38bf091-8fb7-4358-b83b-625887199088 tempest-TestVolumeBootPattern-1166927824 tempest-TestVolumeBootPattern-1166927824-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1559894197" status: 202 len: 0 microversion: 2.1 time: 0.091667 Aug 31 01:40:00.516832 dv-cinder-855288-2-iscsi devstack@n-api.service[121026]: [pid: 121026|app: 0|req: 533/1087] 10.222.0.20 () {58 vars in 1263 bytes} [Wed Aug 31 01:40:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1559894197 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)